Hello everyone!
I also had this issue, so I checked further and it seens to be an issue when provisioning and commissioning on Ubuntu 22.04 LTS when you have an external DHCP server.
When we provision Ubuntu 20 or older there is no issue, and everything works as expected.
Disabling the external DHCP server was enough to fix it.