When a newly deployed Rocky 9 node (build with packer-maas) boots for the first time, it sits for about 2 minutes trying to contact the rack server just before the network is brought up:
Oct 16 13:07:01 ern194 systemd-logind[1143]: Watching system buttons on /dev/input/event0 (Power Button)
Oct 16 13:07:01 ern194 systemd-logind[1143]: Watching system buttons on /dev/input/event1 (HID 0557:2419)
Oct 16 13:07:01 ern194 systemd[1]: Started User Login Management.
Oct 16 13:07:02 ern194 cloud-init[1148]: Cloud-init v. 23.4-7.el9_4.6.0.1 running 'init-local' at Wed, 16 Oct 2024 17:07:02 +0000. Up 8.42 seconds.
Oct 16 13:07:02 ern194 cloud-init[1148]: 2024-10-16 17:07:02,305 - handlers.py[WARNING]: Failed posting event: {"name": "init-local/check-cache", "description": "attempting to read from cache [check]", "event_type": "start", "origin": "cloudinit", "timestamp": 1729098422.2868216}. This was caused by: HTTPConnectionPool(host='<rack server ip>', port=5248): Max retries exceeded with url: /MAAS/metadata/status/k38pye (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa06d739880>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Oct 16 13:07:02 ern194 cloud-init[1148]: 2024-10-16 17:07:02,307 - handlers.py[WARNING]: Failed posting event: {"name": "init-local/check-cache", "description": "no cache found", "event_type": "finish", "origin": "cloudinit", "timestamp": 1729098422.2870731, "result": "SUCCESS"}. This was caused by: HTTPConnectionPool(host='<rack server ip>', port=5248): Max retries exceeded with url: /MAAS/metadata/status/k38pye (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa06d75a880>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Oct 16 13:07:02 ern194 cloud-init[1148]: 2024-10-16 17:07:02,307 - handlers.py[WARNING]: Failed posting event: {"name": "init-local/search-MAAS", "description": "searching for local data from DataSourceMAAS", "event_type": "start", "origin": "cloudinit", "timestamp": 1729098422.296826}. This was caused by: HTTPConnectionPool(host='<rack server ip>', port=5248): Max retries exceeded with url: /MAAS/metadata/status/k38pye (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa06d6e8310>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Oct 16 13:07:11 ern194 /usr/sbin/irqbalance[1139]: Cannot change IRQ 0 affinity: Input/output error
Oct 16 13:07:11 ern194 /usr/sbin/irqbalance[1139]: IRQ 0 affinity is now unmanaged
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,481 - url_helper.py[ERROR]: Timed out, no response from urls: ['http://<rack server ip>:5248/MAAS/metadata/2012-03-01/meta-data/instance-id']
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,482 - DataSourceMAAS.py[CRITICAL]: Giving up on md from ['http://<rack server ip>:5248/MAAS/metadata/2012-03-01/meta-data/instance-id'] after 126 seconds
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,484 - handlers.py[WARNING]: Failed posting event: {"name": "init-local/search-MAAS", "description": "no local data found from DataSourceMAAS", "event_type": "finish", "origin": "cloudinit", "timestamp": 1729098548.4823232, "result": "SUCCESS"}. This was caused by: HTTPConnectionPool(host='<rack server ip>', port=5248): Max retries exceeded with url: /MAAS/metadata/status/k38pye (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa06d6ff970>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,488 - schema.py[WARNING]: Invalid network-config provided:
Oct 16 13:09:08 ern194 cloud-init[1148]: config.1.subnets.0.type: 'manual' is not one of ['dhcp4', 'dhcp', 'dhcp6', 'static', 'static6', 'ipv6_dhcpv6-stateful', 'ipv6_dhcpv6-stateless', 'ipv6_slaac']
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,516 - handlers.py[WARNING]: Failed posting event: {"name": "init-local", "description": "searching for local datasources", "event_type": "finish", "origin": "cloudinit", "timestamp": 1729098548.514639, "result": "SUCCESS"}. This was caused by: HTTPConnectionPool(host='<rack server ip>', port=5248): Max retries exceeded with url: /MAAS/metadata/status/k38pye (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa06d75a190>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Oct 16 13:09:08 ern194 cloud-init[1148]: 2024-10-16 17:09:08,516 - handlers.py[WARNING]: Multiple consecutive failures in WebHookHandler. Cancelling all queued events.
Oct 16 13:09:08 ern194 systemd[1]: Finished Initial cloud-init job (pre-networking).
Oct 16 13:09:08 ern194 systemd[1]: Reached target Preparation for Network.
Oct 16 13:09:08 ern194 systemd[1]: Starting Network Manager...
Oct 16 13:09:08 ern194 NetworkManager[1155]: <info> [1729098548.6883] NetworkManager (version 1.46.0-19.el9_4) is starting... (boot:08949750-274d-462f-8207-62d6fb2207ed)
The UI reports:
Wed, 16 Oct. 2024 17:09:17 Node post-installation failure - 'cloudinit' running modules for config
I know that Rocky 9 isn’t officially supported, and this doesn’t seem to be causing any problems other than a delay on first boot, but does anybody know a quick fix that’ll make this stop happening?