apt cache getting wiped out during ephemeral but only during Deploy

wmjosiah · 26 August 2026 19:59

This applies to MaaS versions 3.6 and 3.7

We have a functional MaaS 3.2 server. I exported the database and imported it into 3.4, then upgraded to 3.5, then to 3.6, then to 3.7 to see if it would fix this problem, which it didn’t. I had to clean up the database somewhat but got the UI all working correctly after deleting references to the old MaaS server and no critical errors seemed to be happening in the logs.

The problem I’m having now is that commissioning and all tests complete just fine, but when you go to deploy a node, a weird thing happens in the ephemeral environment, before the install even happens (I think?), it fails to be able to install two packages, zfsutils-linux and python3-pyudev. You can see from the logs that it has fetched all the apt sources successfully (with what one would assume was an apt update), but then it fails to find these two packages. By using a silly trick to keep the node from rebooting, here:

while true; do ssh ubuntu@quobyte-test05 -oStrictHostKeyChecking=no -oUserKnownHostsFile=/dev/null sudo touch /run/block-curtin-poweroff /tmp/block-poweroff /tmp/block-reboot && break; done

One can prevent the node being installed from rebooting after install failure, and one can ssh into the node and see a number of things:

It’s easy to replicate the error. Just apt install python3-pyudev or zfsutils-linux or literally anything else and it tells you that it can’t find it.
Just run apt update and suddenly everything works fine
The script that is trying to install these things is at /var/lib/cloud/instance/scripts/part-001
/var/lib/cloud/instance/user-data.txt contains the same thing
Said thing is this, followed by a giant binary payload:

#!/bin/bash
# vi: ts=4 expandtab syntax=sh
MD5SUM='2934e40ce42a4540d05c58afb662b1c8'
PREFIX='curtin'
LABEL='curtin'
COMMAND=( 'curtin' '--install-deps' 'install' '--config=configs/config-000.cfg' '--config=configs/config-001.cfg' '--config=configs/config-002.cfg' '--config=configs/config-003.cfg' '--config=configs/config-004.cfg' '--config=configs/config-005.cfg' '--config=configs/config-006.cfg' '--config=configs/config-007.cfg' '--config=configs/config-008.cfg' 'cp:///media/root-ro' )
PYPATH='_pwd_'
BINPATH='_pwd_/bin'
CREATE_TIME='Tue, 25 Aug 2026 13:17:05 +0000'
PAYLOAD_MARKER='_____PAYLOAD_____'
VERBOSITY=0
INFO_KEYS=("LABEL" "PREFIX" "COMMAND" "CREATE_TIME" "MD5SUM")
error() { echo "$@" 1>&2; }
fail() { [ $# -eq 0 ] || error "$@"; exit 1; }
Usage() {
    cat <<EOF
Usage: ${0##*/} [ options ] [mode]
   extract embedded archive
   options:
      -p | --prefix P    override extraction dir (default: $PREFIX)
      -v | --verbose     be more verbose
           --no-execute  extract only, do not execute any bundled command
   mode is one of:
     info:    dump information about archive
     check:   check archive against expected checksum
     dump:    dump archive to stdout
     extract: extract the archive under $PREFIX (default mode)
EOF
}
bad_Usage() { Usage 1>&2; [ $# -eq 0 ] || error "$@"; return 1; }
debug() {
    local level=${1}; shift;
    [ "${level}" -gt "${VERBOSITY}" ] && return
    error "${@}"
}
print_vars() {
    local k karray t="" cur="" tic="'" repltic="'\''"
    for k in "$@"; do
        karray="$k[@]"
        karray=( "${!karray}" )
        if [ ${#karray[@]} -gt 1 ]; then
            cur="("
            for t in "${karray[@]}"; do
                cur="${cur} '${t//${tic}/${repltic}}'"
            done
            cur="${cur} )"
        else
            t=${!k}
            cur="'${t//${tic}/${repltic}}'"
            #printf "%s=\"%s\"" "$k" "${t//'/'\''}"
        fi
        printf "%s=%s\n" "$k" "$cur"
    done
}
dump_b64() {
   sed -n "1,/^${PAYLOAD_MARKER}$/!p" "$1"
}
dump_bin() {
    dump_b64 "$@" | base64 --decode
}
extract() {
    mkdir "$2" || { error "failed to make '$2'"; return 1; }
    # Do not use tar [-S, --sparse] flag, see LP: #1757565
    dump_bin "$1" | tar -xzf - -C "$2"
}
main() {
    local short_opts="hp:v"
    local long_opts="help,no-execute,prefix:,verbose"
    local getopt_out=$(getopt --name "${0##*/}" \
        --options "${short_opts}" --long "${long_opts}" -- "$@") &&
        eval set -- "${getopt_out}" ||
        { bad_Usage; return; }
    local cur="" next="" 
    local prefix="$PREFIX" execute=true
    while [ $# -ne 0 ]; do
        cur="$1"; next="$2";
        case "$cur" in
            -h|--help) Usage ; exit 0;;
               --no-execute) execute=false;;
            -p|--prefix) prefix="$next"; shift;;
            -v|--verbose) VERBOSITY=$((${VERBOSITY}+1));;
            --) shift; break;;
        esac
        shift;
    done
    [ $# -lt 2 ] || { bad_Usage "got $# args. expected only 1"; return; }
    mode="$1"
    case "${mode:-extract}" in
        info) print_vars "${INFO_KEYS[@]}"; return;;
        check)
            found=$(dump_bin "$0" | md5sum) ||
                { error "failed to calculate checksum"; return 1; }
            found=${found%  -}
            [ "$found" = "$MD5SUM" ] &&
                error "found = expected = $found" && return 0
            error "found = ${found}. expected = ${MD5SUM}"
            return 1;;
        dump) dump_bin "$0"; return;;
        extract)
            extract "$0" "$prefix" || { error "failed extraction"; return 1; }
            if [ "${#COMMAND[@]}" = "1" -a -z "${COMMAND}" ]; then
                error "extracted to '$PWD/$prefix'. no command to run."
                return 0;
            fi
            if ! $execute; then
                error "extracted to '$PWD/$prefix'. disabled command"
                return 0;
            fi
            cd "$prefix" ||
                { error "failed to change to $prefix"; return 1; }
            local np=""
            if [ -n "$PYPATH" ]; then
                np="${PYPATH//_pwd_/$PWD}${PYTHONPATH:+:${PYTHONPATH}}"
                export PYTHONPATH="$np"
            fi
            if [ -n "$BINPATH" ]; then
                np="${BINPATH//_pwd_/$PWD}${PATH:+:${PATH}}"
                export PATH="$np"
            fi
            debug 1 "executing: ${COMMAND[*]}"
            exec "${COMMAND[@]}"
            ;;
    esac
    
    return 0
}
set -o pipefail
main "$@"
exit

The logs from the install failure look like this:

2026-08-24T21:50:37.233087+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Loaded 0 symmetric keys
2026-08-24T21:50:37.251921+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Using leap second list /usr/share/zoneinfo/leap-seconds.list
2026-08-24T21:50:37.251976+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Loaded seccomp filter (level 1)
2026-08-24T21:50:37.271869+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started rsyslog.service - System Logging Service.
2026-08-24T21:50:37.281776+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started chrony.service - chrony, an NTP client/server.
2026-08-24T21:50:37.304479+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Added pool 1.ntp.ubuntu.com
2026-08-24T21:50:37.304504+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Added pool 2.ntp.ubuntu.com
2026-08-24T21:50:37.304526+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Added pool 3.ntp.ubuntu.com
2026-08-24T21:50:37.304548+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Added pool 4.ntp.ubuntu.com
2026-08-24T21:50:37.304583+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Added pool ntp-bootstrap.ubuntu.com
2026-08-24T21:50:37.354749+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished apport.service - automatic crash report generation.
2026-08-24T21:50:37.372497+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608237.407:185): apparmor="DENIED" operation="open" class="file" profile="pollinate" name="/usr/share/coreutils/locales/uucore/en-US.ftl" pid=4185 comm="head" requested_mask="r" denied_mask="r" fsuid=102 ouid=0
2026-08-24T21:50:37.433264+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting apt-news.service - Update APT News...
2026-08-24T21:50:37.440136+00:00 maas-vm maas-machine[11784]: [quobyte-test05] pollinate[4016]: client sent challenge to [https://entropy.ubuntu.com/]
2026-08-24T21:50:37.493304+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting esm-cache.service - Update the local ESM caches...
2026-08-24T21:50:37.534449+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started serial-getty@ttyS1.service - Serial Getty on ttyS1.
2026-08-24T21:50:37.604497+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting setvtrgb.service - Set console scheme...
2026-08-24T21:50:37.685572+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608237.720:186): apparmor="DENIED" operation="open" class="file" profile="pollinate" name="/usr/share/coreutils/locales/uucore/en-US.ftl" pid=4211 comm="uname" requested_mask="r" denied_mask="r" fsuid=102 ouid=0
2026-08-24T21:50:37.733165+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished setvtrgb.service - Set console scheme.
2026-08-24T21:50:37.780078+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Created slice system-getty.slice - Slice /system/getty.
2026-08-24T21:50:37.834386+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started getty@tty1.service - Getty on tty1.
2026-08-24T21:50:37.841678+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Reached target getty.target - Login Prompts.
2026-08-24T21:50:37.904079+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] AppArmor D-Bus mediation is enabled
2026-08-24T21:50:37.904146+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started dbus.service - D-Bus System Message Bus.
2026-08-24T21:50:37.920055+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Successfully activated service 'org.freedesktop.systemd1'
2026-08-24T21:50:37.996956+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:1 https://mirror.unity.rc.umass.edu/production/ubuntu resolute InRelease [136 kB]
2026-08-24T21:50:38.008714+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.4' (uid=0 pid=4054 comm="/usr/libexec/udisks2/udisksd" label="unconfined")
2026-08-24T21:50:38.064240+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:2 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates InRelease [137 kB]
2026-08-24T21:50:38.075685+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:3 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security InRelease [137 kB]
2026-08-24T21:50:38.089680+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:4 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports InRelease [136 kB]
2026-08-24T21:50:38.264920+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started polkit.service - Authorization Manager.
2026-08-24T21:50:38.265005+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Successfully activated service 'org.freedesktop.PolicyKit1'
2026-08-24T21:50:38.296005+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting ModemManager.service - Modem Manager...
2026-08-24T21:50:38.326427+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608238.361:187): apparmor="DENIED" operation="open" class="file" profile="pollinate" name="/usr/share/coreutils/locales/uucore/en-US.ftl" pid=4253 comm="head" requested_mask="r" denied_mask="r" fsuid=102 ouid=0
2026-08-24T21:50:38.329525+00:00 maas-vm maas-machine[11784]: [quobyte-test05] pollinate[4016]: client verified challenge/response with [https://entropy.ubuntu.com/]
2026-08-24T21:50:38.332422+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608238.367:188): apparmor="DENIED" operation="open" class="file" profile="pollinate" name="/usr/share/coreutils/locales/uucore/en-US.ftl" pid=4257 comm="cat" requested_mask="r" denied_mask="r" fsuid=102 ouid=0
2026-08-24T21:50:38.420906+00:00 maas-vm maas-machine[11784]: [quobyte-test05] pollinate[4016]: client hashed response from [https://entropy.ubuntu.com/]
2026-08-24T21:50:38.423835+00:00 maas-vm maas-machine[11784]: [quobyte-test05] pollinate[4016]: client successfully seeded [/dev/urandom]
2026-08-24T21:50:38.432305+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started udisks2.service - Disk Manager.
2026-08-24T21:50:38.462795+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:5 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/main amd64 Packages [1480 kB]
2026-08-24T21:50:38.496520+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608238.531:189): apparmor="DENIED" operation="open" class="file" profile="pollinate" name="/usr/share/coreutils/locales/uucore/en-US.ftl" pid=4268 comm="touch" requested_mask="r" denied_mask="r" fsuid=102 ouid=0
2026-08-24T21:50:38.549096+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:6 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/main Translation-en [524 kB]
2026-08-24T21:50:38.562711+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:7 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/main amd64 Components [395 kB]
2026-08-24T21:50:38.575676+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:8 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/main amd64 c-n-f Metadata [32.4 kB]
2026-08-24T21:50:38.588559+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:9 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/restricted amd64 Packages [152 kB]
2026-08-24T21:50:38.601795+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:10 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/restricted Translation-en [25.8 kB]
2026-08-24T21:50:38.616757+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:11 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/restricted amd64 Components [556 B]
2026-08-24T21:50:38.639816+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:12 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/restricted amd64 c-n-f Metadata [388 B]
2026-08-24T21:50:38.652661+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:13 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/universe amd64 Packages [16.0 MB]
2026-08-24T21:50:38.665724+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:14 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/universe Translation-en [6329 kB]
2026-08-24T21:50:38.679942+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: pollinate.service: Deactivated successfully.
2026-08-24T21:50:38.680568+00:00 maas-vm maas-machine[11784]: [quobyte-test05] ModemManager[4249]: <msg> ModemManager (version 1.25.95) starting in system bus...
2026-08-24T21:50:38.680660+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished pollinate.service - Pollinate to seed the pseudo random number generator.
2026-08-24T21:50:38.680846+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: pollinate.service: Consumed 1.560s CPU time over 2.665s wall clock time, 8.8M memory peak.
2026-08-24T21:50:38.680944+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting ssh.service - OpenBSD Secure Shell server...
2026-08-24T21:50:38.702946+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:15 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/universe amd64 Components [4556 kB]
2026-08-24T21:50:38.731126+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:16 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/universe amd64 c-n-f Metadata [313 kB]
2026-08-24T21:50:38.743691+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:17 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/multiverse amd64 Packages [290 kB]
2026-08-24T21:50:38.756579+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:18 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/multiverse Translation-en [127 kB]
2026-08-24T21:50:38.769540+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:19 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/multiverse amd64 Components [50.0 kB]
2026-08-24T21:50:38.782552+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:20 https://mirror.unity.rc.umass.edu/production/ubuntu resolute/multiverse amd64 c-n-f Metadata [8276 B]
2026-08-24T21:50:38.796703+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:21 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/main amd64 Packages [402 kB]
2026-08-24T21:50:38.810670+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:22 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/main Translation-en [103 kB]
2026-08-24T21:50:38.810734+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:23 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/main amd64 Components [62.0 kB]
2026-08-24T21:50:38.836783+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:24 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/main amd64 c-n-f Metadata [5756 B]
2026-08-24T21:50:38.851721+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:25 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/restricted amd64 Packages [298 kB]
2026-08-24T21:50:38.865790+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:26 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/restricted Translation-en [57.3 kB]
2026-08-24T21:50:38.879677+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:27 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/restricted amd64 Components [212 B]
2026-08-24T21:50:38.893758+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:28 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/restricted amd64 c-n-f Metadata [392 B]
2026-08-24T21:50:38.907762+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:29 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/universe amd64 Packages [223 kB]
2026-08-24T21:50:38.920693+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:30 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/universe Translation-en [72.7 kB]
2026-08-24T21:50:38.920746+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:31 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/universe amd64 Components [161 kB]
2026-08-24T21:50:38.956782+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:32 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/universe amd64 c-n-f Metadata [4704 B]
2026-08-24T21:50:38.970702+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:33 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/multiverse amd64 Packages [10.6 kB]
2026-08-24T21:50:38.984746+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:34 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/multiverse Translation-en [2840 B]
2026-08-24T21:50:39.000550+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:35 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/multiverse amd64 Components [216 B]
2026-08-24T21:50:39.015759+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:36 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates/multiverse amd64 c-n-f Metadata [256 B]
2026-08-24T21:50:39.029678+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:37 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/main amd64 Packages [341 kB]
2026-08-24T21:50:39.042829+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:38 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/main Translation-en [86.8 kB]
2026-08-24T21:50:39.055820+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:39 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/main amd64 Components [32.8 kB]
2026-08-24T21:50:39.068785+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:40 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/main amd64 c-n-f Metadata [4616 B]
2026-08-24T21:50:39.082829+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:41 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/restricted amd64 Packages [288 kB]
2026-08-24T21:50:39.096722+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:42 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/restricted Translation-en [55.5 kB]
2026-08-24T21:50:39.111744+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:43 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/restricted amd64 Components [212 B]
2026-08-24T21:50:39.125762+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:44 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/restricted amd64 c-n-f Metadata [396 B]
2026-08-24T21:50:39.139786+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:45 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/universe amd64 Packages [150 kB]
2026-08-24T21:50:39.152677+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:46 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/universe Translation-en [48.3 kB]
2026-08-24T21:50:39.167627+00:00 maas-vm maas-machine[11784]: [quobyte-test05] networkd-dispatcher[4012]: No valid path found for iwconfig
2026-08-24T21:50:39.167674+00:00 maas-vm maas-machine[11784]: [quobyte-test05] networkd-dispatcher[4012]: No valid path found for iw
2026-08-24T21:50:39.168275+00:00 maas-vm maas-machine[11784]: [quobyte-test05] unattended-upgrade-shutdown[4159 /usr/share/unattended-upgrades/unattended-upgrade-shutdown:250: PyGIDeprecationWarning: GLib.unix_signal_add is deprecated; use GLibUnix.signal_add instead
2026-08-24T21:50:39.168319+00:00 maas-vm maas-machine[11784]: [quobyte-test05] unattended-upgrade-shutdown[4159   GLib.unix_signal_add(GLib.PRIORITY_DEFAULT, sig,
2026-08-24T21:50:39.168439+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started ssh.service - OpenBSD Secure Shell server.
2026-08-24T21:50:39.169144+00:00 maas-vm maas-machine[11784]: [quobyte-test05] sshd[4291]: Server listening on 0.0.0.0 port 22.
2026-08-24T21:50:39.169272+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:47 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/universe amd64 Components [43.2 kB]
2026-08-24T21:50:39.184799+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:48 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/universe amd64 c-n-f Metadata [3552 B]
2026-08-24T21:50:39.198807+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:49 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/multiverse amd64 Packages [9020 B]
2026-08-24T21:50:39.212716+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:50 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/multiverse Translation-en [2660 B]
2026-08-24T21:50:39.226797+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:51 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/multiverse amd64 Components [212 B]
2026-08-24T21:50:39.241723+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:52 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security/multiverse amd64 c-n-f Metadata [120 B]
2026-08-24T21:50:39.255744+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:53 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/main amd64 Components [212 B]
2026-08-24T21:50:39.278834+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:54 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/main amd64 c-n-f Metadata [112 B]
2026-08-24T21:50:39.292674+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:55 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/restricted amd64 Components [216 B]
2026-08-24T21:50:39.307710+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:56 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/restricted amd64 c-n-f Metadata [120 B]
2026-08-24T21:50:39.321791+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:57 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/universe amd64 Packages [640 B]
2026-08-24T21:50:39.335762+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:58 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/universe Translation-en [300 B]
2026-08-24T21:50:39.349690+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:59 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/universe amd64 Components [216 B]
2026-08-24T21:50:39.373676+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:60 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/universe amd64 c-n-f Metadata [116 B]
2026-08-24T21:50:39.387606+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:61 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/multiverse amd64 Components [216 B]
2026-08-24T21:50:39.402581+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Get:62 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports/multiverse amd64 c-n-f Metadata [120 B]
2026-08-24T21:50:39.417994+00:00 maas-vm maas-machine[11784]: [quobyte-test05] sshd[4291]: Server listening on :: port 22.
2026-08-24T21:50:39.418190+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started networkd-dispatcher.service - Dispatcher daemon for systemd-networkd.
2026-08-24T21:50:39.418773+00:00 maas-vm maas-machine[11784]: [quobyte-test05] python3[4203]: ["2026-08-24T21:50:39.395", "INFO", "ubuntupro.system", "get_cpu_info", 296, "could not open /proc/sysinfo", {}]
2026-08-24T21:50:39.418824+00:00 maas-vm maas-machine[11784]: [quobyte-test05] python3[4203]: ["2026-08-24T21:50:39.395", "INFO", "ubuntupro.system", "get_cpu_info", 306, "could not open /sys/firmware/devicetree/base/model", {}]
2026-08-24T21:50:39.418886+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started ModemManager.service - Modem Manager.
2026-08-24T21:50:39.517282+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: overlord.go:309: Acquiring state lock file
2026-08-24T21:50:39.517376+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: overlord.go:314: Acquired state lock file
2026-08-24T21:50:39.539814+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: daemon.go:276: started snapd/2.75.2+ubuntu26.04.2 (series 16; classic) ubuntu/26.04 (amd64) linux/7.0.0-27-generic.
2026-08-24T21:50:39.573598+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: loop1: detected capacity change from 0 to 8
2026-08-24T21:50:39.592026+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: daemon.go:370: adjusting startup timeout by 30s (pessimistic estimate of 30s plus 5s per snap)
2026-08-24T21:50:39.592483+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: tmp-syscheck\x2dmountpoint\x2d858514439.mount: Deactivated successfully.
2026-08-24T21:50:39.593739+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: backends.go:70: AppArmor status: apparmor is enabled and all features are available
2026-08-24T21:50:39.712818+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: profile.go:328: snapd enabled root filesystem on overlay support, additional upperdir permissions granted
2026-08-24T21:50:39.712978+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: backend.go:145: reloading profiles for snap-confine
2026-08-24T21:50:39.815705+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: helpers.go:190: error trying to compare the snap system key: system-key missing on disk
2026-08-24T21:50:39.815808+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: apt-news.service: Deactivated successfully.
2026-08-24T21:50:39.821278+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished apt-news.service - Update APT News.
2026-08-24T21:50:39.829036+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: apt-news.service: Consumed 1.546s CPU time over 2.382s wall clock time, 20.7M memory peak.
2026-08-24T21:50:39.864807+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: standby.go:95: will consider standby after: 5s
2026-08-24T21:50:39.864861+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started snapd.service - Snap Daemon.
2026-08-24T21:50:39.921845+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' requested by ':1.11' (uid=0 pid=4026 comm="/usr/lib/snapd/snapd" label="unconfined")
2026-08-24T21:50:39.949405+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting systemd-timedated.service - Time & Date Service...
2026-08-24T21:50:40.010226+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started systemd-timedated.service - Time & Date Service.
2026-08-24T21:50:40.010370+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Successfully activated service 'org.freedesktop.timedate1'
2026-08-24T21:50:40.612503+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: snapmgr.go:1661: performing periodic snap downloads cache cleanup
2026-08-24T21:50:40.612608+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: snapmgr.go:1671: cannot clean store downloads cache: open /var/lib/snapd/cache: no such file or directory
2026-08-24T21:50:40.612649+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: certmgr.go:84: No CA certificate database found, generating it now
2026-08-24T21:50:40.878535+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: dmesg.service: Deactivated successfully.
2026-08-24T21:50:40.900479+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished snapd.seeded.service - Wait until snapd is fully seeded.
2026-08-24T21:50:40.902492+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: snapd.autoimport.service - Auto import assertions from block devices skipped, no trigger condition checks were met.
2026-08-24T21:50:40.902791+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Reached target multi-user.target - Multi-User System.
2026-08-24T21:50:40.903015+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Reached target graphical.target - Graphical Interface.
2026-08-24T21:50:41.092583+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: esm-cache.service: Deactivated successfully.
2026-08-24T21:50:41.098038+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished esm-cache.service - Update the local ESM caches.
2026-08-24T21:50:41.098206+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: esm-cache.service: Consumed 1.659s CPU time over 3.599s wall clock time, 34.9M memory peak.
2026-08-24T21:50:41.119691+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: fbcon: Taking over console
2026-08-24T21:50:41.135642+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: Console: switching to colour frame buffer device 128x48
2026-08-24T21:50:41.617007+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Activating via systemd: service name='org.freedesktop.PackageKit' unit='packagekit.service' requested by ':1.13' (uid=0 pid=4489 comm="/usr/bin/gdbus call --system --dest org.freedeskto" label="unconfined")
2026-08-24T21:50:41.635420+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting packagekit.service - PackageKit Daemon...
2026-08-24T21:50:41.683371+00:00 maas-vm maas-machine[11784]: [quobyte-test05] PackageKit: daemon start
2026-08-24T21:50:41.786688+00:00 maas-vm maas-machine[11784]: [quobyte-test05] dbus-daemon[4002]: [system] Successfully activated service 'org.freedesktop.PackageKit'
2026-08-24T21:50:41.786752+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started packagekit.service - PackageKit Daemon.
2026-08-24T21:50:43.404847+00:00 maas-vm maas-machine[11784]: [quobyte-test05] ModemManager[4249]: <msg> [base-manager] couldn't check support for device '/sys/devices/pci0000:ae/0000:ae:00.0/0000:af:00.0': not supported by any plugin
2026-08-24T21:50:43.404970+00:00 maas-vm maas-machine[11784]: [quobyte-test05] ModemManager[4249]: <msg> [base-manager] couldn't check support for device '/sys/devices/pci0000:ae/0000:ae:00.0/0000:af:00.1': not supported by any plugin
2026-08-24T21:50:44.868530+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: standby.go:101: standby conditions met, initiating standby...
2026-08-24T21:50:44.868765+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: daemon.go:556: gracefully waiting for running hooks
2026-08-24T21:50:44.868798+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: daemon.go:558: done waiting for running hooks
2026-08-24T21:50:45.233641+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: Selected source 91.189.91.113 (4.ntp.ubuntu.com)
2026-08-24T21:50:45.233765+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: System clock TAI offset set to 37 seconds
2026-08-24T21:50:46.412284+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Fetched 33.3 MB in 4s (8583 kB/s)
2026-08-24T21:50:47.073506+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading package lists...
2026-08-24T21:50:47.133110+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4134]: chronyd exiting
2026-08-24T21:50:47.133576+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Stopping chrony.service - chrony, an NTP client/server...
2026-08-24T21:50:47.137229+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: chrony.service: Deactivated successfully.
2026-08-24T21:50:47.143885+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Stopped chrony.service - chrony, an NTP client/server.
2026-08-24T21:50:47.169292+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting chrony.service - chrony, an NTP client/server...
2026-08-24T21:50:47.247505+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: kauditd_printk_skb: 2 callbacks suppressed
2026-08-24T21:50:47.247581+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608247.247:192): apparmor="DENIED" operation="sendmsg" class="file" profile="systemd-detect-virt" name="/apparmor/disconnected/run/systemd/journal/socket" pid=4579 comm="systemd-detect-" requested_mask="w" denied_mask="w" fsuid=0 ouid=0
2026-08-24T21:50:47.247614+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608247.247:193): apparmor="DENIED" operation="capable" class="cap" profile="systemd-detect-virt" pid=4579 comm="systemd-detect-" capability=38  capname="perfmon"
2026-08-24T21:50:47.247656+00:00 maas-vm maas-machine[11784]: [quobyte-test05] kernel: audit: type=1400 audit(1787608247.247:194): apparmor="DENIED" operation="sendmsg" class="file" profile="systemd-detect-virt" name="/apparmor/disconnected/run/systemd/notify" pid=4579 comm="systemd-detect-" requested_mask="w" denied_mask="w" fsuid=0 ouid=0
2026-08-24T21:50:47.256047+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4581]: chronyd version 4.8 starting (+CMDMON +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +NTS +SECHASH +IPV6 -DEBUG)
2026-08-24T21:50:47.256119+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4581]: Loaded 0 symmetric keys
2026-08-24T21:50:47.256684+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4581]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/chrony.drift
2026-08-24T21:50:47.256714+00:00 maas-vm maas-machine[11784]: [quobyte-test05] chronyd[4581]: Loaded seccomp filter (level 1)
2026-08-24T21:50:47.256742+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Started chrony.service - chrony, an NTP client/server.
2026-08-24T21:50:47.292946+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished cloud-config.service - Cloud-init: Config Stage.
2026-08-24T21:50:47.302149+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting cloud-final.service - Cloud-init: Final Stage...
2026-08-24T21:50:47.388286+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Cloud-init v. 26.1-0ubuntu2 running 'modules:final' at Mon, 24 Aug 2026 21:50:47 +0000. Up 50.50 seconds.
2026-08-24T21:50:47.550566+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting apt-news.service - Update APT News...
2026-08-24T21:50:47.577786+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting esm-cache.service - Update the local ESM caches...
2026-08-24T21:50:47.639421+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Hit:1 https://mirror.unity.rc.umass.edu/production/ubuntu resolute InRelease
2026-08-24T21:50:47.639508+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Hit:2 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-updates InRelease
2026-08-24T21:50:47.639539+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Hit:3 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-security InRelease
2026-08-24T21:50:47.639568+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Hit:4 https://mirror.unity.rc.umass.edu/production/ubuntu resolute-backports InRelease
2026-08-24T21:50:47.711109+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: apt-news.service: Deactivated successfully.
2026-08-24T21:50:47.713833+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished apt-news.service - Update APT News.
2026-08-24T21:50:47.906683+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: standby.go:121: standby monitoring stop requested
2026-08-24T21:50:47.906774+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: overlord.go:558: Released state lock file
2026-08-24T21:50:47.906821+00:00 maas-vm maas-machine[11784]: [quobyte-test05] snapd[4026]: daemon stop requested to wait for socket activation
2026-08-24T21:50:47.914265+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: snapd.service: Deactivated successfully.
2026-08-24T21:50:47.920124+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: snapd.service: Consumed 3.795s CPU time over 11.827s wall clock time, 56.9M memory peak.
2026-08-24T21:50:48.249669+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: esm-cache.service: Deactivated successfully.
2026-08-24T21:50:48.255957+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished esm-cache.service - Update the local ESM caches.
2026-08-24T21:50:49.579737+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading package lists...
2026-08-24T21:50:50.034049+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading package lists...
2026-08-24T21:50:50.034170+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Building dependency tree...
2026-08-24T21:50:50.034203+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading state information...
2026-08-24T21:50:50.074860+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: python3-packaging is already the newest version (26.0-1).
2026-08-24T21:50:50.074919+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: python3-packaging set to manually installed.
2026-08-24T21:50:50.134149+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Solving dependencies...
2026-08-24T21:50:50.293513+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: 0 upgraded, 0 newly installed, 0 to remove and 61 not upgraded.
2026-08-24T21:50:50.815070+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting apt-news.service - Update APT News...
2026-08-24T21:50:50.842280+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Starting esm-cache.service - Update the local ESM caches...
2026-08-24T21:50:50.913919+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading package lists...
2026-08-24T21:50:50.971013+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: apt-news.service: Deactivated successfully.
2026-08-24T21:50:50.973928+00:00 maas-vm maas-machine[11784]: [quobyte-test05] systemd[1]: Finished apt-news.service - Update APT News.
2026-08-24T21:50:50.974860+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading package lists...
2026-08-24T21:50:50.979556+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Building dependency tree...
2026-08-24T21:50:50.979605+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reading state information...
2026-08-24T21:50:50.981440+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: E: Unable to locate package zfsutils-linux
2026-08-24T21:50:50.981480+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: E: Unable to locate package python3-pyudev
2026-08-24T21:50:50.982007+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Unexpected error while running command.
2026-08-24T21:50:50.982207+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Command: ['apt-get', '--quiet', '--assume-yes', '--option=Dpkg::options::=--force-unsafe-io', '--option=Dpkg::Options::=--force-confold', '--no-install-recommends', 'install', '--download-only', 'zfsutils-linux', 'python3-pyudev']
2026-08-24T21:50:50.982250+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Exit code: 100
2026-08-24T21:50:50.982279+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Reason: -
2026-08-24T21:50:50.982370+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Stdout: ''
2026-08-24T21:50:50.982437+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: Stderr: ''
2026-08-24T21:50:51.004072+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: 2026-08-24 21:50:51,004 - cc_scripts_user.py[WARNING]: Failed to run module scripts_user (scripts in /var/lib/cloud/instance/scripts)
2026-08-24T21:50:51.004181+00:00 maas-vm maas-machine[11784]: [quobyte-test05] cloud-init[2221]: 2026-08-24 21:50:51,005 - log_util.py[WARNING]: Running module scripts_user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python3/dist-packages/cloudinit/config/cc_scripts_user.py'>) failed

I’ve tried addressing this with an extra apt update in both early or late stages with the curtin preseed file, but it doesn’t help, as I think this is before that even starts… right?

Any ideas as to next troubleshooting steps or why this might be happening? Obviously this keeps MaaS from being useful to us, so I’m still running the old version. I’d really rather not start over again as we have a large database and about 600 nodes in it that it would be a large pain to lose.

Thanks in advance for any advice.

-Josiah

Associate Director of RCD

UMass Amherst

aloiziomacedo · 27 August 2026 12:58

Hi, @wmjosiah !

It is unclear when you exactly first found the issue in the chain you mentioned (3.2→3.4→…). Can you clarify? Was it in 3.6?

If possible, can you also try to export the db to 3.7 directly and run the migrations (after creating a backup of it)? We had some bugfixes related to curtin and cloud-init on 3.7 (and 3.6 for that matter) which, from what I recall, might be related to this issue. (We don’t do tests for this kind of transition directly, but the point-wise migrations should behave the same.)

All that said, I see two main theories:

There might be some issue with the commissioning image you are using. Can you give some details about it, and also about any modifications to the cloud-init config?
It might also be the case that the updates did not properly update the version of curtin your MAAS is using (which would explain some of the issues you are facing with the apt installs). This would be more likely if you are using debs, I think. Can you double-check which one is being used? That can be done by sshing into the node as you did.

wmjosiah · 27 August 2026 16:17

Thanks so much for your reply! The commissioning/install images are mirrored from maas.io unmodified. I have never dived into modifying images. I am also using a default /etc/maas/preseeds/curtin_userdata file other than the attempted addition of an extra apt update in early_commands (and I tried late_commands too for the heck of it). I also tried masking the esm-cache and the apt-news service in the bootcmd section but that didn’t seem to work. In default config it also doesn’t work.

I’m feeling a bit lost (this will reveal my ignorance!) when you ask me what version of curtin we’re using but then say to check by ssh’ing into the failed install node. The failed install node doesn’t report curtin as being installed at all. On the MAAS server it’s 23.1.1-1120-g650b4ee8-0ubuntu1~ubuntu24.04.1 and yes, I’m using debs.

I didn’t try going straight to 3.7 with an import of the database from 3.2 because I thought you had to go through 3.4. Perhaps that isn’t the case! I can try that if these other parts of this conversation don’t bear fruit.

Thanks so much again!

aloiziomacedo · 27 August 2026 19:24

@wmjosiah Not your ignorance! It is a little bit of a complicated process : )

Curtin is used on demand as a script, if I recall correctly. You would be able to check it when it starts actually running (because it will be unpacked in a given directory in the node), but it won’t be installed per se.

I would go into more details, but I think we identified the issue: 23.1.1-1120-g650b4ee8-0ubuntu1~ubuntu24.04.1 is an outdated version. You should be having something like 23.1.1-1127-g68310ce3-0ubuntu1~ubuntu24.04.1. Looking into the PPAs, I think 3.6 and 3.7 might have to be updated on our end.

I will confirm with the team if our PPA is really outdated. If it is, I will get back to you soon : )

wmjosiah · 27 August 2026 20:16

That would be amazing if that was the fix! Thanks so much!

aloiziomacedo · 28 August 2026 14:26

We updated the PPA. Can you try incorporating it and see if it fixes your issue?

wmjosiah · 28 August 2026 17:47

Success!!! That got me to python3-curtin version 23.1.1-1127-g68310ce3-0ubuntu1~ubuntu24.04.1 and all is well!

Yay! Thank you!