Hello!
My application has started experiencing extreme latency of around 2 minutes per request. The application hasn’t been deployed or otherwise changed recently so I don’t believe the issue is on the application side.
These lines have started showing in the logs:
2024-03-03T19:37:41Z app[6e82977a00d0d8] lhr [info]level=INFO msg=“630CDEC9A3705B3F: exiting primary, destroying lease”
2024-03-03T19:37:53Z app[6e82977a00d0d8] lhr [info]level=INFO msg=“cannot set environment metadata” reason=“retries exceeded” err=“Post "http://localhost/v1/apps/gleam-packages/machines/6e82977a00d0d8/metadata/role\”: context deadline exceeded"
2024-03-03T19:38:15Z app[6e82977a00d0d8] lhr [info]level=INFO msg=“cannot release consul key: key=gleam-packages-jpon17o0p0lqdgr4/litefs/gleam-packages session=b40333a5-8455-abe3-5984-8ef9e21a2d4a”
I’ve tried restarting the application and scaling up additional instances but it did not resolve the issue.
The Fly status page shows no issues, but the status page for my specific Fly account won’t load.
Thanks,
Louis