App is down and can't deploy because machine is unreachable

1

A user contacted me because a service isn’t working. I haven’t deployed this app in 4 months and has been working flawlessly since then.

When I do fly machines list I can see the machine seems to be stuck in starting.

wavekit-worker-machines
ID            	NAME              	STATE   	REGION	IMAGE	IP ADDRESS	VOLUME	CREATED             	LAST UPDATED        	APP PLATFORM	PROCESS GROUP	SIZE
91857293c74328	hidden-sunset-6401	starting	      	:    	          	      	1970-01-01T00:00:00Z	0001-01-01T00:00:00Z

I’ve tried deploying but I get this error:

Error: found 1 machines that are unmanaged

I’ve tried restarting and destroying the machine but I get:

Error: could not get machine 91857293c74328: failed to get VM 91857293c74328: invalid machine ID, '91857293c74328'

I’m on the latest version of flyctl:

fly version update
Already running latest flyctl v0.1.87

What should I do? Delete the app and create a new one?

2

In the dashboard there’s this alert message from 2 days ago.

image
image2434×540 42.6 KB

3

I’ve got the same, machine ID 080e652f614618

4

I was able to clone the machine and destroy the zombie one with --force.

2 Likes
5

and did you get it to work on the cloned machine?

6

Yeah everything seems back to normal now with this app.

7

will do the same, appreciate it! :pray:

8

sadly for me it infinitely keeps pulling and times out

2023-09-04T16:12:21.683 runner[e82d492f732048] ams [info] Pulling container image registry.fly.io/bolmailer-55eb:deployment-01H9GF8R4SBBFXXWG0HC12B1HW

9

@camielk your current troubles may be related to this incident: Fly.io Status - Failing to pull image

1 Like
10

A possible workaround has been posted on the status page (FLY_REGISTRY_HOST=registry2.fly.io). We can see it is now using registry2 but still issues with pulling the image.

11

Can you try using registry-iad.fly.io?

12

Thanks! One app has deployed fine but after that we are seeing the same issue.

13

how do i use FLY_REGISTRY_HOST=registry-iad.fly.io fly auth docker docker push registry-iad.fly.io/torem-app:latest this? i’ve seen it but i don’t know where to use that

14

are you pushing with docker directly to the registry or just deploying?

15

I am deploying

16

then you can just run FLY_REGISTRY_HOST=registry-iad.fly.io fly deploy and it will switch the registry

17

thank you

18

App is down, deployment successful but my app is not reachable…

19

this also worked for me. data / volume was also attached. all is fine.

20

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.