Solution: Firmware Update Boot Loop¶
Triage¶
- Connect to iLO/BMC remote console immediately. Observe the POST cycle and note:
- Does POST complete fully? Any error messages?
- Is the boot disk visible in the POST device list?
-
What boot mode is displayed (UEFI / Legacy)?
-
Review the BMC Integrated Management Log (IML):
Look for: firmware flash status, memory training errors, boot device missing. -
Check if the BIOS settings were reset to defaults. Many firmware updates reset all BIOS configuration. The most common cause of this symptom is boot mode changed from UEFI to Legacy (or vice versa) after a settings reset.
Root Cause¶
The BIOS update reset settings to factory defaults. The server was installed with UEFI boot mode, but factory default is Legacy BIOS. With the wrong boot mode, the firmware cannot locate the UEFI boot partition (EFI System Partition), so it cycles through all boot devices and restarts.
This is confirmed by the serial console showing "Discovering boot devices..." with no UEFI boot entries listed.
Fix¶
- Enter BIOS Setup during POST (F9 on HPE):
- Navigate to Boot Options
- Change Boot Mode from "Legacy BIOS" to "UEFI Mode"
-
Save and exit
-
If boot order was also reset, re-add the correct boot entry:
- In UEFI Boot Order, ensure the OS disk (e.g., RAID logical drive or NVMe) is first
-
Remove PXE/network boot from first position if it was moved there
-
If Secure Boot keys were cleared:
- Re-enroll default Secure Boot keys (Reset to manufacturer defaults in Secure Boot config)
-
Or temporarily disable Secure Boot to get the OS booting, then re-enable
-
If BIOS settings are complex (custom power profiles, SR-IOV, etc.):
-
Restore from the pre-update BIOS configuration backup via iLO:
-
After the OS boots, verify all services are running and the system is healthy:
Rollback / Safety¶
-
HPE servers have a redundant ROM feature. If the new BIOS is actually corrupted:
This reverts to the pre-update BIOS image stored in the backup flash chip. -
If the OS disk is suspected damaged, boot from iLO virtual media (mount an ISO) and inspect the disk.
-
Before making BIOS changes, screenshot/export the current (default) settings so you can compare against the desired configuration.
Common Traps¶
- Trap: Assuming the firmware flash failed or is corrupted. In most cases, the flash succeeded -- it just reset settings to defaults.
- Trap: Not exporting BIOS settings before the update. Always use
conrep(HPE) orsyscfg/ BIOS config backup before flashing. - Trap: Flashing firmware without checking compatibility matrices. BIOS updates sometimes require matching CPLD, ME, or RAID controller firmware versions.
- Trap: Panicking and re-flashing the BIOS again without checking settings first, which wastes time and adds risk.
- Trap: Not testing the boot mode change on a single server before rolling out to a fleet.