start: host=orderly root=m1s_emmc frontdoor=handover flag=absent TEST handover [after plain reboot] t+28s host=orderly root=m1s_emmc frontdoor=handover flag=absent TEST flag [rescue system] t+35s host=orderly-rescue root=RESCUE-ARM frontdoor=flag flag=absent time setup in the rescue system: exit 0 | Reference ID : A29FC87B (time.cloudflare.com) baseline in the rescue system: exit 0 | BASELINE DONE [plain reboot from rescue] t+27s host=orderly root=m1s_emmc frontdoor=handover flag=absent TEST dtb moved aside [eMMC dtb missing] t+35s host=orderly-rescue root=RESCUE-ARM frontdoor=noemmc flag=absent repair from rescue: device tree restored: 115510 bytes [after repair and reboot-to-os] t+26s host=orderly root=m1s_emmc frontdoor=handover flag=absent TEST kernel moved aside [eMMC kernel missing] t+36s host=orderly-rescue root=RESCUE-ARM frontdoor=noemmc flag=absent repair from rescue: kernel restored: vmlinuz-6.18.54-current-rockchip64 35916288 bytes [after repair and reboot-to-os] t+29s host=orderly root=m1s_emmc frontdoor=handover flag=absent TEST panic (crashes the kernel) armed: kernel.panic = 10 [after the panic crash] t+54s host=orderly root=m1s_emmc frontdoor=handover flag=absent mux_client_request_session: read from master failed: Broken pipe back after 54 s, uptime 39 s, kernel.panic restored to 10; the panic text reached haywire TEST watchdog (crashes the kernel) armed: kernel.panic = 0 Traceback (most recent call last): File "/home/cisco/projects/network/scripts/sbc/m1s_rescue_selftest.py", line 124, in sys.exit(main()) ~~~~^^ File "/home/cisco/projects/network/scripts/sbc/m1s_rescue_selftest.py", line 104, in main o = b.wait(f"after the {name} crash", delay=20, limit=300); took = int(time.time() - t_crash) File "/home/cisco/projects/network/scripts/sbc/m1s_rescue_selftest.py", line 50, in wait rc, o = self.ssh(STATE) ~~~~~~~~^^^^^^^ File "/home/cisco/projects/network/scripts/sbc/m1s_rescue_selftest.py", line 39, in ssh r = subprocess.run(["ssh", "-i", KEY, "-o", "IdentitiesOnly=yes", "-o", "BatchMode=yes", "-o", "ConnectTimeout=4", "-o", f"UserKnownHostsFile={KH}", "-o", "StrictHostKeyChecking=accept-new", f"root@{self.name}", cmd], input=stdin, capture_output=True, text=True, timeout=timeout) File "/usr/lib/python3.14/subprocess.py", line 557, in run stdout, stderr = process.communicate(input, timeout=timeout) ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.14/subprocess.py", line 1221, in communicate stdout, stderr = self._communicate(input, endtime, timeout) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.14/subprocess.py", line 2154, in _communicate self._check_timeout(endtime, orig_timeout, stdout, stderr) ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.14/subprocess.py", line 1268, in _check_timeout raise TimeoutExpired( ...<2 lines>... stderr=b''.join(stderr_seq) if stderr_seq else None) subprocess.TimeoutExpired: Command '['ssh', '-i', '/home/cisco/.ssh/cisco_haywire_2026', '-o', 'IdentitiesOnly=yes', '-o', 'BatchMode=yes', '-o', 'ConnectTimeout=4', '-o', 'UserKnownHostsFile=/home/cisco/.cache/m1s-known-hosts', '-o', 'StrictHostKeyChecking=accept-new', 'root@orderly', "set -euo pipefail && echo host=$(hostname) root=$(findmnt -no LABEL /) $(tr ' ' '\\n' < /proc/cmdline | grep -E '^frontdoor' | paste -sd' ') flag=$([ -e /rescue.flag ] && echo present || echo absent)"]' timed out after 120 seconds