FLAME children always seem to time out

I can’t seem to get any children in a FLAME.Pool to ever start up.

The logs are very vague, and just say that the child timed out. I’m not even sure where.

Here are the logs:

2023-12-18T07:10:06Z app[17811020c016d8] mia [info][    0.170476] PCI: Fatal: No config space access function found
2023-12-18T07:10:07Z app[17811020c016d8] mia [info] INFO Starting init (commit: 15238e9)...
2023-12-18T07:10:07Z app[17811020c016d8] mia [info] INFO Preparing to run: `/app/bin/gm_familiar start` as nobody
2023-12-18T07:10:07Z app[17811020c016d8] mia [info] INFO [fly api proxy] listening at /.fly/api
2023-12-18T07:10:07Z app[17811020c016d8] mia [info]2023/12/18 07:10:07 listening on [fdaa:3:c270:a7b:189:f950:e51b:2]:22 (DNS: [fdaa::3]:53)
2023-12-18T07:10:11Z app[17811020c016d8] mia [info] WARN Reaped child process with pid: 362 and signal: SIGUSR1, core dumped? false
2023-12-18T07:10:15Z app[918575d5f53078] mia [info]07:10:15.504 [notice] Application gm_familiar exited: GmFamiliar.Application.start(:normal, []) returned an error: shutdown: failed to start child: {FLAME.Pool, GmFamiliar.FlamePool}
2023-12-18T07:10:15Z app[918575d5f53078] mia [info]    ** (EXIT) shutdown: failed to start child: {FLAME.Pool, GmFamiliar.FlamePool}
2023-12-18T07:10:15Z app[918575d5f53078] mia [info]        ** (EXIT) exited in: Task.Supervised.stream(10000)
2023-12-18T07:10:15Z app[918575d5f53078] mia [info]            ** (EXIT) time out

Any idea what could be going on or where I can look next?

I’m able to ssh into the flame machine and view it’s logs. Nothing there either. It looks like my elixir app starts up, then the timeout happens and it shuts down the flame machine

It seems like the POST request to fly is timing out. Which is really weird as i can see the fly machine start up and even ssh into it

Okay got it. Since I’m using a custom dockerfile and not the default phoenix build setup that fly uses, it never set up the correct clustering environment variables for me. After getting those set up, it all runs pretty smoothly.

Here are the docs I used for those looking in the future: Clustering Your Application · Fly Docs

1 Like