This didn’t happen with MAAS 2.6, but now that we’ve upgraded to 3.3.5, we keep getting DNS query drops whenever we deploy a host.
I made a script that flushes my DNS caches and every 10 seconds queries for an entry on our MAAS server. On Wednesday I deployed hosts, and just a few minutes ago I began deploying. The log loooks like this:
Wed Feb 28 01:57:26 PM UTC 2024: DNS lookup failed!
Wed Feb 28 01:57:36 PM UTC 2024: DNS lookup failed!
Wed Feb 28 02:01:17 PM UTC 2024: DNS lookup failed!
Fri Mar 1 06:22:15 AM UTC 2024: DNS lookup failed!
Fri Mar 1 06:23:45 AM UTC 2024: DNS lookup failed!
Fri Mar 1 06:23:55 AM UTC 2024: DNS lookup failed!
Fri Mar 1 06:24:05 AM UTC 2024: DNS lookup failed!
And the failures just keep on coming.
Naturally our cloud-init scripts at the deployment phase will also fail the DNS lookups and thus fail the deployment.
The loads on the servers is negligible, and the server (VM) has 4 vCPUs and 8 GB or RAM. It should easily handle this.
please open a bug on launchpad and upload your logs/scripts
1 Like
This could be due to the same bug as described here.
Try running snap restart maas
to see if it resolves your issue. Then tail the DNS logfile to see what action causes DNS zone updates to start failing again.