App stuck in suspended/starting state with no useful logs

My app, which was working for a while, stopped working. The dashboard shows it as “suspended”.

I ran flyctl restart which says

Restarting machine 5683935c5dd778
Error: could not stop machine 5683935c5dd778: failed to restart VM 5683935c5dd778: internal: internal server error (Request ID: 01HJXTZSZWP4JDX2WCGPEJBCD7-ord)

flyctl logs shows:

error.message="timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)" 2023-12-30T17:03:29Z proxy[5683935c5dd778] ord [error]request.method="POST" request.id="01HJXTSHTFZ8J95A7RHV0XGNVK-ord"
error.message="timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)" 2023-12-30T17:03:33Z proxy[5683935c5dd778] ord [error]request.method="POST" request.id="01HJXTSHTFZ8J95A7RHV0XGNVK-ord"
error.message="timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)" 2023-12-30T17:03:37Z proxy[5683935c5dd778] ord [error]request.method="POST" request.id="01HJXTSHTFZ8J95A7RHV0XGNVK-ord"
error.message="timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)" 2023-12-30T17:03:41Z proxy[5683935c5dd778] ord [error]request.method="POST" request.id="01HJXTSHTFZ8J95A7RHV0XGNVK-ord"
2023-12-30T17:03:45Z proxy[5683935c5dd778] ord [error]timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)
2023-12-30T17:03:49Z proxy[5683935c5dd778] ord [error]timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)
2023-12-30T17:03:53Z proxy[5683935c5dd778] ord [error]timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)

flyctl ssh console says

Error: app appname has no started VMs.
It may be unhealthy or not have been deployed yet.
Try the following command to verify:

fly status

fly status shows:

Machines
PROCESS	ID            	VERSION	REGION	STATE   	ROLE	CHECKS	LAST UPDATED
app    	5683935c5dd778	4      	ord   	starting	    	      	2023-12-15T22:58:36Z

it’s interesting this says starting even though the dashboard says suspended

Anyway, how can I figure out what’s wrong? It seems like I have no way to get to the logs or restart the server. Any advice or ideas are welcome.

I couldn’t figure out any way to get it running, so I destroyed the machine and cloned the volume

fly m clone 5683935c5dd778 --from-snapshot last

really weird this happened though, it’d be great to get some kind of explanation so i don’t have to do it in the future

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.