DHCP issue after upgrade to MAAS 3.7

fwendland · 4 February 2026 09:05

I’ve recently had to update Ubuntu from 22.04 LTS to 24.04 LTS. After the update I also went ahead and updated MAAS from v3.3 to v3.7 (Debian packages). However, since then I have problems with the DHCP configuration.

So far, I’ve figured out, that /var/lib/maas/dhcpd-interfaces and the respective dhcpd_.conf are all empty. On each restart, the maas-dhcpd_.service fails, because the dhcpd_.conf files are initially missing.

On the Web UI, everything looks good. I have a fabric with VLANs and subnets defined. For some MAAS manages DHCP.

I can’t find a reason, why MAAS doesn’t pick up the DHCP configuration. Any help in troubleshooting this problem is highly appreciated.

r00ta · 4 February 2026 09:15

There were a bunch of DHCP-related bugs in 3.7.0 that are waiting to be released in 3.7.1 (ETA next days/early next week) 3.7.x : MAAS

I’d suggest to try 3.7/edge

fwendland · 4 February 2026 09:23

Thank you r00ta for the quick response. There isn’t a Debian package release for 3.7/edge, is there?

r00ta · 4 February 2026 09:57

maas-3.7-next : Jack-Skye Owen-Lloyd-Walters and it’s currently under certification

osmanlicilegi · 1 March 2026 10:20

I am not sure whether this problem has been fixed because I have some clusters affected with this bug and haven’t been fixed after upgrading to 3.7.1.

fwendland · 2 March 2026 07:40

@osmanlicilegi Unfortunately, I cannot provide feedback yet. I’m waiting for the next maintenance window to install the update. I’ll keep you posted.

jim-golden · 18 March 2026 16:23

I am having this same issue on two separate maas servers and 3.7.1 hasn’t fixed it for me. I can revert back to 3.6.2 which fixes the DHCP problem, but then I get an internal server error when trying to deploy.

Update for anyone else who may run into this after downgrading back to 3.6. The error was an issue with is_dpu being required for 3.7. I had to manually edit the database with:

“ALTER TABLE maasserver_node ALTER COLUMN is_dpu DROP NOT NULL;”

and that seems to have fixed deployments for now. I hopefully this doesn’t bite me down the road so use with caution.

slines · 2 April 2026 15:29

I also ran into this empty interfaces dhcp issue when upgrading from 3.6.1 to 3.7.1 via deb packages. I also tried 3.7-next from https://launchpad.net/~lloydwaltersj/+archive/ubuntu/maas-3.7-next which didn’t help. Ended up reverting to 3.6.1. We’re blocked on upgrading until this is fixed.

r00ta · 2 April 2026 20:15

3.7.2 has been released, you might want to try that

slines · 13 April 2026 20:40

My rack controllers are running snaps, I took them from 3.6.1 to 3.7.2 just now and got a new error on all three rack controllers that I see in the region controller UI:
maas-rack0
2 dead, 6 running
and the two dead are these:
dhcpd- (b’UNHANDLED’, “Unhandled Command: b’ConfigureDHCPv4’”)
dhcpd6- (b’UNHANDLED’, “Unhandled Command: b’ConfigureDHCPv6’”)

Error log from /var/log/syslog on rack controller

2026-04-13T20:28:33.611367+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.611Z [pebble] GET /v1/services?names=dhcpd 30.832µs 200
2026-04-13T20:28:38.949547+00:00 maas-rack0 maas-log[1030284]: maas.drivers.power.ipmi: message repeated 12 times: [ [warn] using a non-secure cipher suite id]
2026-04-13T20:28:38.949944+00:00 maas-rack0 maas-log[1030284]: maas.power: [error] cnt31: Power state could not be queried: Connection timed out while performing power action. Check BMC configuration and connectivity and try again.
2026-04-13T20:28:39.310480+00:00 maas-rack0 maas-log[1030284]: maas.power: [error] cnt31: Could not query power state: Connection timed out while performing power action. Check BMC configuration and connectivity and try again..
…skipping…
2026-04-13T20:30:47.493359+00:00 maas-rack0 maas-agent[1030725]: INF Started power-service Attempt=1 Namespace=default RunID=d8992e94-5d81-40e9-a3e1-15061b3dcb04 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-power-service:nyd6dp WorkflowType=configure-power-service
2026-04-13T20:30:47.688994+00:00 maas-rack0 maas-agent[1030725]: INF Configuring httpproxy-service Attempt=1 Namespace=default RunID=2bce3418-4d6c-4365-a9ad-104738e1f7fb SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service
2026-04-13T20:30:47.940198+00:00 maas-rack0 maas-agent[1030725]: INF Started httpproxy-service Attempt=1 Namespace=default RunID=2bce3418-4d6c-4365-a9ad-104738e1f7fb SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service targets=[{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null}]
2026-04-13T20:30:48.136810+00:00 maas-rack0 maas-agent[1030725]: INF Configuring dhcp-service Attempt=1 Namespace=default RunID=ce7e45f1-d591-4a76-8793-d1b7b7b57f2b SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:30:48.137160+00:00 maas-rack0 maas-agent[1030725]: INF Started dhcp-service Attempt=1 Namespace=default RunID=ce7e45f1-d591-4a76-8793-d1b7b7b57f2b SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:30:48.330066+00:00 maas-rack0 maas-agent[1030725]: INF Activity complete after timeout. ActivityType=apply-dhcp-config-via-file Attempt=1 Error=“request failed: Get “https:///MAAS/a/v3internal/agents/nyd6dp/services/dhcp/config”: context deadline exceeded” Namespace=default Result=null RunID=da3d5db1-d5e5-4a97-a645-b3712c86a3ff TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp:nyd6dp
2026-04-13T20:30:48.330480+00:00 maas-rack0 maas-agent[1030725]: INF Task processing failed with client side error Error=“context deadline exceeded” Namespace=default TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030725 WorkerType=ActivityWorkerrack0 maas-agent[1030518]: ERR Workflow configure-agent failed error=“workflow execution error (type: configure-agent, workflowID: configure-agent:nyd6dp, runID: 6bd332b1-4fe1-48ae-94dc-fc4cfd59a95
1): Workflow timeout (type: StartToClose)”
2026-04-13T20:26:41.897540+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:26:41.895Z [pebble] Service “agent” stopped unexpectedly with code 1
2026-04-13T20:26:41.897627+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:26:41.895Z [pebble] Service “agent” on-failure action is “restart”, waiting ~500ms before restart (backoff 1)
2026-04-13T20:26:42.436860+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:26:42.436Z [pebble] Service “agent” starting: sh -c “exec systemd-cat -t maas-agent $SNAP/bin/run-maas-agent”
2026-04-13T20:26:42.479616+00:00 maas-rack0 maas-agent[1030615]: INF Logger is configured with log level “info”
2026-04-13T20:26:43.211750+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:43.420497+00:00 maas-rack0 maas-agent[1030615]: INF Configuring power-service Attempt=1 Namespace=default RunID=2a1eadc6-70c9-450c-951b-9b8db5cc0a76 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=000000000
00000000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-power-service:nyd6dp WorkflowType=configure-power-service
2026-04-13T20:26:43.768482+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=agent:power@vlan-9 WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:43.965543+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=agent:power@vlan-33 WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:44.158806+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=agent:power@vlan-34 WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:44.354810+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=agent:power@vlan-69 WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:44.552516+00:00 maas-rack0 maas-agent[1030615]: INF Started Worker Namespace=default TaskQueue=nyd6dp@agent:power WorkerID=nyd6dp@agent:1030615
2026-04-13T20:26:44.552634+00:00 maas-rack0 maas-agent[1030615]: INF Started power-service Attempt=1 Namespace=default RunID=2a1eadc6-70c9-450c-951b-9b8db5cc0a76 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=0000000000000
0000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-power-service:nyd6dp WorkflowType=configure-power-service
2026-04-13T20:26:44.760263+00:00 maas-rack0 maas-agent[1030615]: INF Configuring httpproxy-service Attempt=1 Namespace=default RunID=891a99c1-aa5a-4330-bcd4-a33f13428150 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000
000000000000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service
2026-04-13T20:26:45.054380+00:00 maas-rack0 maas-agent[1030615]: INF Started httpproxy-service Attempt=1 Namespace=default RunID=891a99c1-aa5a-4330-bcd4-a33f13428150 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=000000000
00000000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service targets=[{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:"
“,“Path”:”/MAAS/“,“RawFragment”:”“,“RawPath”:”“,“RawQuery”:”“,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:”“,“Host”:”:5240",“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:
“”,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null}]
2026-04-13T20:26:45.358962+00:00 maas-rack0 maas-agent[1030615]: INF Configuring dhcp-service Attempt=1 Namespace=default RunID=8455fd62-14c7-4757-ae48-c99661b925c8 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=0000000000
0000000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:26:45.360238+00:00 maas-rack0 maas-agent[1030615]: INF Started dhcp-service Attempt=1 Namespace=default RunID=8455fd62-14c7-4757-ae48-c99661b925c8 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000
000000000000000000 WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:26:45.621660+00:00 maas-rack0 maas-agent[1030615]: INF Activity complete after timeout. ActivityType=apply-dhcp-config-via-file Attempt=1 Error=“request failed: Get “https:///MAAS/a/v3internal/agents/ny
d6dp/services/dhcp/config”: context deadline exceeded” Namespace=default Result=null RunID=8370261d-eb87-4234-a9ef-15f276b9f689 TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030615 WorkflowID=configure-dhcp:nyd6dp
2026-04-13T20:26:45.622155+00:00 maas-rack0 maas-agent[1030615]: INF Task processing failed with client side error Error=“context deadline exceeded” Namespace=default TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030615 WorkerType
=ActivityWorker
2026-04-13T20:27:03.600094+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.598Z [pebble] GET /v1/services?names=proxy 247.2µs 200
2026-04-13T20:27:03.601575+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.600Z [pebble] GET /v1/services?names=ntp 74.464µs 200
2026-04-13T20:27:03.601657+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.601Z [pebble] GET /v1/services?names=dhcpd6 23.178µs 200
2026-04-13T20:27:03.601711+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.601Z [pebble] GET /v1/services?names=dhcpd 27.4µs 200
2026-04-13T20:27:03.601749+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.601Z [pebble] GET /v1/services?names=http 22.615µs 200
2026-04-13T20:27:03.601826+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.601Z [pebble] GET /v1/services?names=agent 22.633µs 200
2026-04-13T20:27:03.601891+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:03.601Z [pebble] GET /v1/services?names=syslog 41.19µs 200
2026-04-13T20:27:03.603824+00:00 maas-rack0 kernel: kauditd_printk_skb: 112 callbacks suppressed
2026-04-13T20:27:03.603842+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.602:258428): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/2/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.604879+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.603:258429): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/3/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.604888+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.603:258430): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/4/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.604889+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.603:258431): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/5/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.604891+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.603:258432): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/6/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.604892+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.604:258433): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/7/environ” pid=1030623 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.606783+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.605:258434): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/12/environ” pid=1030623 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.606792+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.605:258435): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/13/environ” pid=1030623 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.607779+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.606:258436): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/14/environ” pid=1030623 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:03.607787+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112023.606:258437): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/15/environ” pid=1030623 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.599899+00:00 maas-rack0 kernel: kauditd_printk_skb: 111 callbacks suppressed
2026-04-13T20:27:33.599959+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.598:258549): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/2/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603327+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258550): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/3/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603342+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258551): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/4/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603344+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258552): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/5/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603345+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258553): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/6/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603347+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258554): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/7/environ” pid=1030631 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603348+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258555): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/12/environ” pid=1030631 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603349+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258556): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/13/environ” pid=1030631 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603349+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258557): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/14/environ” pid=1030631 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.603350+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112053.601:258558): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/15/environ” pid=1030631 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:27:33.663147+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.662Z [pebble] GET /v1/services?names=http 173.206µs 200
2026-04-13T20:27:33.668807+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.666Z [pebble] GET /v1/services?names=agent 40.417µs 200
2026-04-13T20:27:33.668891+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.667Z [pebble] GET /v1/services?names=syslog 26.819µs 200
2026-04-13T20:27:33.668944+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.667Z [pebble] GET /v1/services?names=proxy 22.666µs 200
2026-04-13T20:27:33.668994+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.667Z [pebble] GET /v1/services?names=ntp 23.565µs 200
2026-04-13T20:27:33.669047+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.667Z [pebble] GET /v1/services?names=dhcpd6 20.747µs 200
2026-04-13T20:27:33.669088+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:27:33.667Z [pebble] GET /v1/services?names=dhcpd 27.823µs 200
2026-04-13T20:28:03.599191+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.597Z [pebble] GET /v1/services?names=dhcpd6 66.459µs 200
2026-04-13T20:28:03.600623+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=dhcpd 25.709µs 200
2026-04-13T20:28:03.600684+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=http 55.12µs 200
2026-04-13T20:28:03.600723+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=agent 25.667µs 200
2026-04-13T20:28:03.600791+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=ntp 22.386µs 200
2026-04-13T20:28:03.600834+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=proxy 21.924µs 200
2026-04-13T20:28:03.600895+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:03.598Z [pebble] GET /v1/services?names=syslog 29.232µs 200
2026-04-13T20:28:03.601187+00:00 maas-rack0 kernel: kauditd_printk_skb: 112 callbacks suppressed
2026-04-13T20:28:03.601203+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.599:258671): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/2/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602793+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258672): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/3/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602803+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258673): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/4/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602804+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258674): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/5/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602806+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258675): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/6/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602809+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258676): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/7/environ” pid=1030668 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602811+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258677): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/12/environ” pid=1030668 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.602812+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.600:258678): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/13/environ” pid=1030668 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.604785+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.602:258679): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/14/environ” pid=1030668 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:03.604794+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112083.602:258680): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/15/environ” pid=1030668 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.602827+00:00 maas-rack0 kernel: kauditd_printk_skb: 111 callbacks suppressed
2026-04-13T20:28:33.602848+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.601:258792): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/2/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.604782+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.603:258793): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/3/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.604807+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.603:258794): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/4/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.604809+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.603:258795): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/5/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.605801+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.604:258796): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/6/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.605810+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.604:258797): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/7/environ” pid=1030680 comm=“ps” requested_mask="
r" denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.606715+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.606Z [pebble] GET /v1/services?names=http 2.157702ms 200
2026-04-13T20:28:33.607037+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.605:258798): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/12/environ” pid=1030680 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.607040+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.606:258799): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/13/environ” pid=1030680 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.607807+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.606:258800): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/14/environ” pid=1030680 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.608880+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.608Z [pebble] GET /v1/services?names=agent 1.151699ms 200
2026-04-13T20:28:33.609152+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.609Z [pebble] GET /v1/services?names=syslog 29.885µs 200
2026-04-13T20:28:33.609422+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.609Z [pebble] GET /v1/services?names=proxy 36.979µs 200
2026-04-13T20:28:33.609703+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.609Z [pebble] GET /v1/services?names=ntp 28.946µs 200
2026-04-13T20:28:33.610193+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.610Z [pebble] GET /v1/services?names=dhcpd6 35.574µs 200
2026-04-13T20:28:33.610815+00:00 maas-rack0 kernel: audit: type=1400 audit(1776112113.609:258801): apparmor=“DENIED” operation=“open” class=“file” profile=“snap.maas.pebble” name=“/proc/15/environ” pid=1030680 comm=“ps” requested_mask=
“r” denied_mask=“r” fsuid=0 ouid=0
2026-04-13T20:28:33.611367+00:00 maas-rack0 maas.pebble[1030179]: 2026-04-13T20:28:33.611Z [pebble] GET /v1/services?names=dhcpd 30.832µs 200
2026-04-13T20:28:38.949547+00:00 maas-rack0 maas-log[1030284]: maas.drivers.power.ipmi: message repeated 12 times: [ [warn] using a non-secure cipher suite id]
2026-04-13T20:28:38.949944+00:00 maas-rack0 maas-log[1030284]: maas.power: [error] cnt31: Power state could not be queried: Connection timed out while performing power action. Check BMC configuration and connectivity and try again.
2026-04-13T20:28:39.310480+00:00 maas-rack0 maas-log[1030284]: maas.power: [error] cnt31: Could not query power state: Connection timed out while performing power action. Check BMC configuration and connectivity and try again..
…skipping…
2026-04-13T20:30:47.493359+00:00 maas-rack0 maas-agent[1030725]: INF Started power-service Attempt=1 Namespace=default RunID=d8992e94-5d81-40e9-a3e1-15061b3dcb04 SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-power-service:nyd6dp WorkflowType=configure-power-service
2026-04-13T20:30:47.688994+00:00 maas-rack0 maas-agent[1030725]: INF Configuring httpproxy-service Attempt=1 Namespace=default RunID=2bce3418-4d6c-4365-a9ad-104738e1f7fb SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service
2026-04-13T20:30:47.940198+00:00 maas-rack0 maas-agent[1030725]: INF Started httpproxy-service Attempt=1 Namespace=default RunID=2bce3418-4d6c-4365-a9ad-104738e1f7fb SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-httpproxy-service:nyd6dp WorkflowType=configure-httpproxy-service targets=[{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null},{“ForceQuery”:false,“Fragment”:“”,“Host”:“:5240”,“OmitHost”:false,“Opaque”:“”,“Path”:“/MAAS/”,“RawFragment”:“”,“RawPath”:“”,“RawQuery”:“”,“Scheme”:“http”,“User”:null}]
2026-04-13T20:30:48.136810+00:00 maas-rack0 maas-agent[1030725]: INF Configuring dhcp-service Attempt=1 Namespace=default RunID=ce7e45f1-d591-4a76-8793-d1b7b7b57f2b SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:30:48.137160+00:00 maas-rack0 maas-agent[1030725]: INF Started dhcp-service Attempt=1 Namespace=default RunID=ce7e45f1-d591-4a76-8793-d1b7b7b57f2b SpanID=0000000000000000 TaskQueue=nyd6dp@agent:main TraceID=00000000000000000000000000000000 WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp-service:nyd6dp WorkflowType=configure-dhcp-service
2026-04-13T20:30:48.330066+00:00 maas-rack0 maas-agent[1030725]: INF Activity complete after timeout. ActivityType=apply-dhcp-config-via-file Attempt=1 Error=“request failed: Get “https:///MAAS/a/v3internal/agents/nyd6dp/services/dhcp/config”: context deadline exceeded” Namespace=default Result=null RunID=da3d5db1-d5e5-4a97-a645-b3712c86a3ff TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030725 WorkflowID=configure-dhcp:nyd6dp
2026-04-13T20:30:48.330480+00:00 maas-rack0 maas-agent[1030725]: INF Task processing failed with client side error Error=“context deadline exceeded” Namespace=default TaskQueue=nyd6dp@agent:main WorkerID=nyd6dp@agent:1030725 WorkerType=ActivityWorker

r00ta · 13 April 2026 21:12

You have some controllers still running 3.6. Make sure everything is running 3.7. Also, use 3.7.3 which contain some bugfixes

slines · 16 April 2026 05:39

I don’t see 3.7.3 generally available. Is that the same as 3.7-next?

I tried another full upgrade to 3.7.2 and dhcpd became status “inactive” across the whole fleet, and systemctl status maas-dhcpd says:
failed because of an unmet condition check (ConditionPathExists=/var/lib/maas/dhcpd.conf).

r00ta · 16 April 2026 06:33

Sorry I meant 3.7.2 do you ha TLS enabled?

slines · 16 April 2026 16:49

Yes, I do have TLS enabled.

r00ta · 16 April 2026 17:53

You are hitting MaaS instance can download images or start DHCP server, not both - #13 by r00ta