MAAS stuck on grub prompt during second reboot on deploy

Discourse
21

can you also check the maas-agent logs?

22

nothing significant in maas-agent logs, only logs containing power activity.

23

can you add debug: true in /var/snap/maas/current/rackd.conf, restart MAAS and reproduce it again?

Also, can you always reproduce it? Does it work with other machines?

24

debug: true is already enabled in /etc/maas/rackd.conf. yes, i can always reproduce it with this set of machines.

25

what machine is it? Do you have other machines that are working fine?

27

it’s a HPE ProLiant DL380 Gen11. i have another set of working servers that are Gen10 Plus.

28

Are they working fine? Have you tried to update all the firmwares?

29

yes the Gen10s are working fine.

30

are you using the latest greatest firmware versions?

31

both gen11 and 10 are not on the latest firmware versions

32

please upgrade them first

33

thanks for the quick response, let me try upgrading them first.

34

it’s the same after upgrading to the latest firmware.

could this be due to cloud-init failing to report back to MAAS and therefore, stuck at rebooting?

i was comparing the packets captured by the successful deployment (gen10) and the one that failed (gen11). after block 4476, the successful deployment made POST calls to the metadata service and ran cloud-init init-network stage.

Read Request, File: grubx64.efi
Acknowledgement, Block: 0
Acknowledgement, Block 4476
POST /MAAS/metadata/status/id
{"name": "init-network /check-cache", "description": "no cache found", "event_type": "finish", "origin": "cloud-init", "result": "SUCCESS"}
POST /MAAS/metadata/status/id
{"name": "init-network /search-MAAS", "description": "searching for network data from DataSourceMAAS", "event_type": "start", "origin": "cloud-init"}
POST /MAAS/metadata/status/id
{"name": "init-network /search-MAAS", "description": "found network data from DataSourceMAAS", "event_type": "finish", "origin": "cloud-init", "result": "SUCCESS"}