Failed to add a VM to MAAS 3.2.6

We are trying to install openstack charms, as a part of it we installed MAAS and attempted to create a MAAS cluster. We tried adding a Virtual Machine created on KVM to MAAS. But we faced an error, "Failed to power on node - Power on for the node failed: Failed talking to node's BMC: Failed to login to virsh console".

Systems used:

  1. For MAAS --> KVM Virtual Machine, Ubuntu 20.04, 8GB RAM, 50GB, 2 vcpus
  2. For JUJU --> KVM Virtual Machine, PXE boot, 4GB RAM, 50GB, 2vcpus

Steps followed:

  1. Installed KVM on Ubuntu 20.04 server.
  2. Created a VM for MAAS.
  3. Installed MAAS. Followed https://docs.openstack.org/project-deploy-guide/charm-deployment-guide/yoga/install-maas.html.
  4. Enabled DHCP for MAAS.
  5. Created another VM for juju installation and set boot option to pxe boot.
  6. Added the machine to MAAS using virsh power type. Followed https://ubuntu.com/blog/quick-add-kvms-for-maas this article.
  7. When we try to commission the node, its failing and we are facing an error.

We are stuck here and would appreciate any help.

Same here … Same setup with MaaS 3.1 works as expected but switching to 3.2 made VMs not to complete comissioning.

Same issue, fails on commissioning.

EDIT:
My logs state that commissioning times out:
Marking node failed - Node operation 'Commissioning' timed out after 30 minutes.

Could you please provide more details about your hardware setup? Are you trying to do this all on one server or do you have multiple bare metal machines?

Have you tried registering the VM host as a virsh host in maas? There’s currently a bug that prevents you from deploying a machine as a LXD/KVM host, but you should still be able to manually add the host under the KVM section.

My best guess is that your maas install doesn’t have access to manage your vm server. Try going to <maas-ip>:5240/MAAS/r/kvm/virsh and adding your vm host into maas. (you don’t have to provision the actual host with maas). I would also recommend you try lxd if you have trouble with virsh.

@mounika-alavala, can you share some more info:

  1. The output of snap list maas or apt list maas (depending on which you’re using)
  2. I think you’re using the UI, but please confirm.
  3. Add log file output from:
  • maas.log
  • regiond.log
  • rackd.log
  • the rsyslog file of the affected machine(s), if it exists.

On snap, these files are located as follows (you’ll have to sudo su - to read them}:

/var/snap/maas/common/log/maas.log
/var/snap/maas/common/log/regiond.log
/var/snap/maas/common/log/rackd.log
/var/snap/maas/common/log/rsyslog/$MACHINE_NAME/$RELEVANT_DATE/messages

If you’re using packages, you’ll find the files in these locations:

/var/log/maas/maas.log
/var/log/maas/regiond.log
/var/log/maas/rackd.log
/var/log/maas/rsyslog/$MACHINE_NAME/$RELEVANT_DATE/messages

Hi @billwear, Thanks for responding. Below are the responses.

  1. Output of snap list maas
Name  Version                  Rev    Tracking    Publisher    Notes
maas  3.2.6-12016-g.19812b4da  23947  3.2/stable  canonical**  -
  1. Yes I am using UI
  2. maas.log

2022-10-18T10:23:50.754401+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Downloading image descriptions from http:/>
2022-10-18T10:23:50.754897+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Region downloading image descriptions from>
2022-10-18T10:23:53.746922+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootsources: [info] Updated boot sources cache.
2022-10-18T10:23:53.773267+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [info] Started importing of boot images from 1 so>
2022-10-18T10:23:53.774019+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Downloading image descriptions from http:/>
2022-10-18T10:23:53.774119+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Region downloading image descriptions from>
2022-10-18T10:23:56.230214+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [info] Importing images from source: http://image>
2022-10-18T10:23:57.956475+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:57.985640+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:58.016156+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:58.044500+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:58.074283+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:58.102604+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [warn] Ignoring unsupported filetype(manifest) fr>
2022-10-18T10:23:58.885538+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.bootresources: [info] Finished importing of boot images from 1 s>
2022-10-18T10:23:58.899982+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Starting rack boot image import
2022-10-18T10:23:58.905950+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Downloading image descriptions from http:/>
2022-10-18T10:23:58.906162+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Rack downloading image descriptions from '>
2022-10-18T10:23:59.030780+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Finished importing boot images, the region>
2022-10-18T10:23:59.033690+05:30 maaskvm-Standard-PC-Q35-ICH9-2009 maas.import-images: [info] Starting rack boot image import

regiond.log

2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:amd64:ga-22.04-lowlatency: >
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:arm64:ga-22.04: to_add=[] t>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:arm64:xgene-uboot: to_add=[>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:arm64:xgene-uboot-mustang: >
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:armhf:ga-22.04: to_add=[] t>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:armhf:generic-lpae-generic->
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:ppc64el:ga-22.04: to_add=[]>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.04:s390x:ga-22.04: to_add=[] t>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:v3:download/com.ubuntu.maas.stable:v3:boot:22.10:s390x:ga-22.10: to_add=[] t>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:centos-bases-download/com.ubuntu.maas.stable:centos-bases:7.0:amd64: to_add=>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:centos-bases-download/com.ubuntu.maas.stable:centos-bases:8:amd64: to_add=[]>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:1:bootloader-download/com.ubuntu.maas.stable:1:grub-efi-signed:uefi:amd64: t>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:1:bootloader-download/com.ubuntu.maas.stable:1:grub-efi:uefi:arm64: to_add=[>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:1:bootloader-download/com.ubuntu.maas.stable:1:grub-ieee1275:open-firmware:p>
2022-10-18 04:53:58 sstreams: [info] com.ubuntu.maas:stable:1:bootloader-download/com.ubuntu.maas.stable:1:pxelinux:pxe:i386: to_add=['2>
2022-10-18 04:53:58 maasserver.clusterrpc.boot_images: [info] Rack controller (gfmsxr) has imported boot resources.
2022-10-18 04:58:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >
2022-10-18 05:03:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >
2022-10-18 05:04:38 maasserver.rpc.leases: [info] Lease update: commit for 192.168.122.118 on 52:54:0:31:be:f4 at 2022-10-18 05:04:38 (l>
2022-10-18 05:08:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >
2022-10-18 05:13:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >
2022-10-18 05:18:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >
2022-10-18 05:23:44 maasserver.regiondservices.active_discovery: [info] Active network discovery: Active scanning is not enabled on any >

rackd.log

2022-10-18 09:33:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 09:33:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 09:43:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 09:43:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 09:53:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 09:53:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 10:03:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 10:03:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 10:13:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 10:13:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 10:23:41 provisioningserver.rackdservices.dhcp_probe_service: [info] Probe for external DHCP servers started on interfaces: e>
2022-10-18 10:23:51 provisioningserver.rackdservices.dhcp_probe_service: [info] External DHCP probe complete.
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:grub-efi-signed:amd64:generic:uefi: to_add=[‘20210819.0’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:grub-efi:arm64:generic:uefi: to_add=[‘20210819.0’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:grub-ieee1275:ppc64el:generic:open-firmware: to_add=[‘20210509.0’] to_re>
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:pxelinux:i386:generic:pxe: to_add=[‘20210203.0’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:ga-20.04-lowlatency:focal: to_add=[‘20221010’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:ga-20.04:focal: to_add=[‘20221010’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:hwe-20.04-edge:focal: to_add=[‘20221010’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:hwe-20.04-lowlatency-edge:focal: to_add=[‘20221010’] to_rem>
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:hwe-20.04-lowlatency:focal: to_add=[‘20221010’] to_remove=[]
2022-10-18 10:23:59 sstreams: [info] maas:v2:download/maas:boot:ubuntu:amd64:hwe-20.04:focal: to_add=[‘20221010’] to_remove=[]

rsyslog file doesn’t exist.

Hi @ben-ihelputech, Thanks for responding.
We are doing all this in one server only. I haven’t registered VM host in KVM section. I directly tried adding VM to Machines using virsh. Will try registering the host first.

thanks, @mounika-alavala! i’ll take a look this week.

@mounika-alavala, your log files don’t show anything about the KVM interactions, and there’s no rsyslog file. can you pull up MAAS and see if it has actually has enlisted any machines?