My app went down with this incident too and i cannot get machines up again.
I’ve tried this mutliple times
I created a machine and it is stuck in a stopped state
fly machines list
1 machines have been retrieved from app reggu-prod.
View them in the UI here (https://fly.io/apps/reggu-prod/machines/)
reggu-prod
ID NAME STATE REGION IMAGE IP ADDRESS VOLUME CREATED LAST UPDATED APP PLATFORM PROCESS GROUP SIZE
683d610a716418 cold-violet-4297 stopped sin reggu-prod: fdaa:0:4d47:a7b:185:c50b:a577:2 2024-04-12T06:43:08Z 2024-04-12T06:44:16Z v2 app shared-cpu-1x:1024MB
So I destroy the machine
fly machines destroy 683d610a716418 --force
machine 683d610a716418 was found and is currently in stopped state, attempting to destroy...
683d610a716418 has been destroyed
Create a new machine
fly scale count 1 --region sin
App 'reggu-prod' is going to be scaled according to this plan:
+1 machines for group 'app' on region 'sin' of size 'shared-cpu-1x'
? Scale app reggu-prod? Yes
Executing scale plan
Created 48ed192a71ded8 group:app region:sin size:shared-cpu-1x
Then the machine fails to start repeatedly.
2024-04-12T06:45:01Z runner[48ed192a71ded8] sin [info]Successfully prepared image registry.fly.io/reggu-prod@sha256:3e1793d3272cef58b31c512fd85176f33e2f4610bb7176373525235a0ab586e3 (2.970973845s)
2024-04-12T06:45:02Z runner[48ed192a71ded8] sin [info]Configuring firecracker
2024-04-12T06:45:03Z app[48ed192a71ded8] sin [info][ 0.077384] PCI: Fatal: No config space access function found
2024-04-12T06:45:03Z app[48ed192a71ded8] sin [info] INFO Starting init (commit: 5b8fb02)...
2024-04-12T06:45:03Z app[48ed192a71ded8] sin [info] INFO Preparing to run: `/app/bin/server` as nobody
2024-04-12T06:45:03Z app[48ed192a71ded8] sin [info] INFO [fly api proxy] listening at /.fly/api
2024-04-12T06:45:03Z app[48ed192a71ded8] sin [info]2024/04/12 06:45:03 listening on [fdaa:0:4d47:a7b:185:c1c6:c461:2]:22 (DNS: [fdaa::3]:53)
2024-04-12T06:45:03Z runner[48ed192a71ded8] sin [info]Machine created and started in 4.627s
2024-04-12T06:45:07Z app[48ed192a71ded8] sin [info]Protocol 'inet6_tcp': invalid node name: reggu-prod-prod@sha256:3e1793d3272cef58b31c512fd85176f33e2f4610bb7176373525235a0ab586e3@fdaa:0:4d47:a7b:185:c1c6:c461:2
2024-04-12T06:45:08Z app[48ed192a71ded8] sin [info] INFO Main child exited normally with code: 1
2024-04-12T06:45:08Z app[48ed192a71ded8] sin [info] WARN Reaped child process with pid: 363 and signal: SIGUSR1, core dumped? false
2024-04-12T06:45:08Z app[48ed192a71ded8] sin [info] INFO Starting clean up.
2024-04-12T06:45:08Z app[48ed192a71ded8] sin [info][ 5.532757] reboot: Restarting system
2024-04-12T06:45:08Z runner[48ed192a71ded8] sin [info]machine did not have a restart policy, defaulting to restart
2024-04-12T06:45:09Z app[48ed192a71ded8] sin [info][ 0.066917] PCI: Fatal: No config space access function found
2024-04-12T06:45:09Z app[48ed192a71ded8] sin [info] INFO Starting init (commit: 5b8fb02)...
2024-04-12T06:45:09Z app[48ed192a71ded8] sin [info] INFO Preparing to run: `/app/bin/server` as nobody
2024-04-12T06:45:09Z app[48ed192a71ded8] sin [info] INFO [fly api proxy] listening at /.fly/api
2024-04-12T06:45:09Z runner[48ed192a71ded8] sin [info]Machine started in 702ms
Nothing has changed on my end