App not responding since restarting.

I just redeployed an app without making any changes, and since then it will no longer respond to any requests. However the deploy succeeds as though there’s no issue. I’m also not seeing any problems in the logs. After a minute I’m getting a 502 response.

Same here, our production environment is currently not responding :rotating_light: Didn’t change any config since the last deplyment. Tried a restart but without any effect:

2022-12-01T14:48:51Z runner[53665ff6] fra [info]Shutting down virtual machine

2022-12-01T14:48:51Z runner[8e6fcad8] fra [info]Shutting down virtual machine

2022-12-01T14:48:51Z app[8e6fcad8] fra [info]Sending signal SIGINT to main child process w/ PID 528

2022-12-01T14:48:51Z runner[8afb5aaf] fra [info]Shutting down virtual machine

2022-12-01T14:48:51Z app[53665ff6] fra [info]Sending signal SIGINT to main child process w/ PID 528

2022-12-01T14:48:51Z app[53665ff6] fra [info][01-Dec-2022 14:48:51] NOTICE: Terminating ...

2022-12-01T14:48:51Z app[53665ff6] fra [info][01-Dec-2022 14:48:51] NOTICE: exiting, bye-bye!

2022-12-01T14:48:51Z app[53665ff6] fra [info][cont-finish.d] executing container finish scripts...

2022-12-01T14:48:51Z app[53665ff6] fra [info][cont-finish.d] done.

2022-12-01T14:48:51Z app[53665ff6] fra [info][s6-finish] waiting for services.

2022-12-01T14:48:51Z app[8afb5aaf] fra [info]Sending signal SIGINT to main child process w/ PID 528

2022-12-01T14:48:51Z app[53665ff6] fra [info][s6-finish] sending all processes the TERM signal.

2022-12-01T14:48:51Z app[53665ff6] fra [info]hallpass exited, pid: 529, status: signal: 1

2022-12-01T14:48:51Z app[53665ff6] fra [info]hallpass exited, pid: 788, status: signal: 15

2022-12-01T14:48:51Z app[53665ff6] fra [info]2022/12/01 14:48:51 listening on [fdaa:0:8271:a7b:23c4:2:81cc:2]:22 (DNS: [fdaa::3]:53)

2022-12-01T14:48:51Z app[8afb5aaf] fra [info]Starting clean up.

2022-12-01T14:48:51Z app[8afb5aaf] fra [info]Umounting /dev/vdc from /var/www/html/storage/c

2022-12-01T14:48:52Z app[8e6fcad8] fra [info]Starting clean up.

2022-12-01T14:48:52Z app[8e6fcad8] fra [info]Umounting /dev/vdc from /var/www/html/storage/c

2022-12-01T14:48:52Z app[53665ff6] fra [info]Starting clean up.

2022-12-01T14:48:52Z app[53665ff6] fra [info]Umounting /dev/vdc from /var/www/html/storage/c

2022-12-01T14:48:54Z runner[d47e8d33] fra [info]Starting instance

2022-12-01T14:48:54Z runner[3ca6872e] fra [info]Starting instance

2022-12-01T14:48:55Z runner[85f00742] fra [info]Starting instance

2022-12-01T14:48:56Z runner[3ca6872e] fra [info]Configuring virtual machine

2022-12-01T14:48:56Z runner[3ca6872e] fra [info]Pulling container image

2022-12-01T14:48:56Z runner[3ca6872e] fra [info]Unpacking image

2022-12-01T14:48:56Z runner[3ca6872e] fra [info]Preparing kernel init

2022-12-01T14:48:57Z runner[3ca6872e] fra [info]Setting up volume 'storage_club'

2022-12-01T14:48:57Z runner[3ca6872e] fra [info]Opening encrypted volume

2022-12-01T14:48:57Z runner[3ca6872e] fra [info]Configuring firecracker

2022-12-01T14:48:57Z runner[3ca6872e] fra [info]Starting virtual machine

2022-12-01T14:48:57Z runner[85f00742] fra [info]Configuring virtual machine

2022-12-01T14:48:57Z runner[85f00742] fra [info]Pulling container image

2022-12-01T14:48:57Z app[3ca6872e] fra [info]Starting init (commit: f447594)...

2022-12-01T14:48:57Z app[3ca6872e] fra [info]Mounting /dev/vdc at /var/www/html/storage/c w/ uid: 0, gid: 0 and chmod 0755

2022-12-01T14:48:57Z app[3ca6872e] fra [info]Preparing to run: `/entrypoint php artisan queue:work` as root

2022-12-01T14:48:57Z app[3ca6872e] fra [info]2022/12/01 14:48:57 listening on [fdaa:0:8271:a7b:86:2:df9f:2]:22 (DNS: [fdaa::3]:53)

2022-12-01T14:48:58Z runner[85f00742] fra [info]Unpacking image

2022-12-01T14:48:58Z runner[85f00742] fra [info]Preparing kernel init

2022-12-01T14:48:58Z runner[85f00742] fra [info]Setting up volume 'storage_club'

2022-12-01T14:48:58Z runner[85f00742] fra [info]Opening encrypted volume

2022-12-01T14:48:58Z runner[85f00742] fra [info]Configuring firecracker

2022-12-01T14:48:59Z runner[85f00742] fra [info]Starting virtual machine

2022-12-01T14:48:59Z app[85f00742] fra [info]Starting init (commit: f447594)...

2022-12-01T14:48:59Z app[85f00742] fra [info]Mounting /dev/vdc at /var/www/html/storage/c w/ uid: 0, gid: 0 and chmod 0755

2022-12-01T14:48:59Z app[85f00742] fra [info]Preparing to run: `/entrypoint` as root

2022-12-01T14:48:59Z app[85f00742] fra [info]2022/12/01 14:48:59 listening on [fdaa:0:8271:a7b:23c4:2:81cc:2]:22 (DNS: [fdaa::3]:53)

2022-12-01T14:49:02Z app[85f00742] fra [info][s6-init] making user provided files available at /var/run/s6/etc...exited 0.

2022-12-01T14:49:02Z app[85f00742] fra [info][s6-init] ensuring user provided files have correct perms...exited 0.

2022-12-01T14:49:02Z app[85f00742] fra [info][fix-attrs.d] applying ownership & permissions fixes...

2022-12-01T14:49:02Z app[85f00742] fra [info][fix-attrs.d] done.

2022-12-01T14:49:02Z app[85f00742] fra [info][cont-init.d] executing container initialization scripts...

2022-12-01T14:49:02Z app[85f00742] fra [info][cont-init.d] done.

2022-12-01T14:49:02Z app[85f00742] fra [info][services.d] starting services

2022-12-01T14:49:02Z app[85f00742] fra [info][services.d] done.

2022-12-01T14:49:02Z app[85f00742] fra [info][01-Dec-2022 14:49:02] NOTICE: fpm is running, pid 736

2022-12-01T14:49:02Z app[85f00742] fra [info][01-Dec-2022 14:49:02] NOTICE: ready to handle connections

2022-12-01T14:49:02Z app[85f00742] fra [info][01-Dec-2022 14:49:02] NOTICE: systemd monitor interval set to 10000ms

2022-12-01T14:49:07Z runner[d47e8d33] fra [info]Configuring virtual machine

2022-12-01T14:49:07Z runner[d47e8d33] fra [info]Pulling container image

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Unpacking image

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Preparing kernel init

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Setting up volume 'storage_club'

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Opening encrypted volume

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Configuring firecracker

2022-12-01T14:49:08Z runner[d47e8d33] fra [info]Starting virtual machine

2022-12-01T14:49:09Z app[d47e8d33] fra [info]Starting init (commit: f447594)...

2022-12-01T14:49:09Z app[d47e8d33] fra [info]Mounting /dev/vdc at /var/www/html/storage/c w/ uid: 0, gid: 0 and chmod 0755

2022-12-01T14:49:09Z app[d47e8d33] fra [info]Preparing to run: `/entrypoint cron -f` as root

2022-12-01T14:49:09Z app[d47e8d33] fra [info]2022/12/01 14:49:09 listening on [fdaa:0:8271:a7b:c07e:2:dfa0:2]:22 (DNS: [fdaa::3]:53)

Okay even after rolling back to exactly that image which have been deployed, still no reaction from the containers.
Any solution?? Status page not showing any incidents. I guess here is a need to identify this issue and track that one on the monitoring…

And it’s back up. Didn’t change anything.

Exact same on my side… I actually expect to know the cause