Blancco: sweep full NIC driver tree into kexec-initrd + verbose init

Previous approach listed ~6 specific drivers (e1000e, igb, tg3, bnx2,
bnxt_en, b44) and silenced insmod errors (2>/dev/null). On modern Dell
fleet (Latitude 5330/5440, Pro-series, newer OptiPlex) this missed
igc (Intel I225/I226) entirely, and for the drivers we did include,
dependency modules they need at insmod time (libeth, libie, dca,
i2c-algo-bit, macsec, mii, libphy, ptp, ...) were never bundled.
insmod does not resolve dependencies, so NIC drivers that need
helpers failed to load silently.

playbook/pxe_server_setup.yml (kexec-initrd build):
  - Sweep the whole drivers/net/ethernet tree (~170 drivers, all
    vendors, ~15 MB total). Drivers for hardware not present skip
    without binding.
  - Add common helper dirs: drivers/net/{phy,mdio}, drivers/i2c/algos,
    drivers/dca, drivers/ptp, net/macsec, drivers/ssb.
  - overlay.ko kept.

playbook/blancco-init.sh:
  - Load helpers BEFORE main NIC drivers (libeth/libie, dca,
    i2c-algo-bit, macsec, mii, ssb, libphy, mdio*, phy*, ptp*),
    then iterate remaining modules.
  - Remove 2>/dev/null on insmod so actual failures surface on the
    boot console.
  - Print kernel version + /sys/class/net before/after driver load,
    plus dmesg grep for NIC driver activity.
  - On "no interface found" failure, dump dmesg tail and drop to a
    busybox shell for manual debug rather than just hanging.

Separate from this commit but related: kexec-initrd.img on both PXE
servers (.1 and .2) was rebuilt inline with these changes. Pre-rebuild
binary kept as kexec-initrd.img.bak-<timestamp>.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

playbook/blancco-init.sh

@@ -20,14 +20,38 @@ mount -t devtmpfs devtmpfs /dev 2>/dev/null
 mkdir -p /tmp /run
 
 echo "[1/4] Loading NIC drivers..."
+echo "  Kernel: $(uname -r)"
+echo "  Interfaces before driver load: $(ls /sys/class/net/ 2>/dev/null)"
+
+# Dependency modules first. insmod does not resolve deps; main NIC
+# drivers like igb need dca + i2c-algo-bit, atlantic needs macsec,
+# some Intel drivers need libeth/libie. Load helpers first so the
+# main driver module has its required symbols available.
+for mod in /lib/modules/libeth.ko /lib/modules/libie*.ko /lib/modules/dca.ko \
+           /lib/modules/i2c-algo-bit.ko /lib/modules/macsec.ko \
+           /lib/modules/mii.ko /lib/modules/ssb.ko /lib/modules/libphy.ko \
+           /lib/modules/mdio*.ko /lib/modules/phy*.ko /lib/modules/ptp*.ko; do
+    [ -f "$mod" ] || continue
+    insmod "$mod" 2>&1 | grep -v '^$' | head -1 || true
+done
+
+# Main NIC drivers (everything else in /lib/modules/ that is not a helper
+# or the overlay/squashfs modules). Errors are now VISIBLE so if a
+# driver fails to load we can see why.
 for mod in /lib/modules/*.ko; do
-    echo "  insmod $(basename $mod)"
-    insmod $mod 2>/dev/null || true
+    base=$(basename "$mod")
+    case "$base" in
+        libeth.ko|libie*.ko|dca.ko|i2c-algo-bit.ko|macsec.ko|mii.ko|ssb.ko|libphy.ko|overlay.ko|squashfs.ko|mdio*.ko|phy*.ko|ptp*.ko)
+            continue ;;
+    esac
+    echo "  insmod $base"
+    insmod "$mod" 2>&1 | head -1 || true
 done
 sleep 5
 
-echo "  Interfaces after driver load:"
-ls /sys/class/net/ 2>/dev/null
+echo "  Interfaces after driver load: $(ls /sys/class/net/ 2>/dev/null)"
+echo "  Kernel messages mentioning NIC driver activity:"
+dmesg 2>/dev/null | grep -iE "eth|igc|igb|bnxt|tg3|r8169|atlantic|e1000|ixgbe|i40e|eno|ens|enp" | tail -20
 
 echo "  Waiting for network interface..."
 IFACE=""
@@ -47,9 +71,13 @@ done
 echo ""
 
 if [ -z "$IFACE" ]; then
-    echo "ERROR: No network interface found!"
-    echo "Available interfaces:"
-    ls /sys/class/net/ 2>/dev/null
+    echo ""
+    echo "ERROR: No network interface found after 60s."
+    echo "  /sys/class/net/: $(ls /sys/class/net/ 2>/dev/null)"
+    echo "  Last 40 lines of dmesg (look for probe failures):"
+    dmesg 2>/dev/null | tail -40
+    echo ""
+    echo "  Dropping to busybox shell for manual debug. reboot with 'reboot -f'."
     exec sh
 fi