Thanks for the help!
For some reason I can’t reach the VMs. Running flyctl ssh console -s only lists the working instance of the app. The running but non working VMs show in the fly-metrics.net dashboard, but there is no way to interact with them.
I tried deleting the app, and created it again, and somehow the logs still show on the “Monitoring” tab.