Grafana not ingesting/displaying logs

I noticed that logs are no longer appearing in Grafana. I’ve found a few other threads that point to this happening after deploys, but there were no changes made. The last deploy was ~12 hours before the logs stopped, and redeploying the app hasn’t fixed it.

When I run fly logs the terminal shows logs up to the same point Grafana shows them, but I am able to live tail new logs. However, if I kill and restart my fly logs session any new logs are gone.

What could cause log storage/ingestion to stop completely?

The logs cluster was operating partially degraded this morning leading to some log drops. We’ve fixed it - can you take a look again? We’ll be upgrading the entire cluster today as well, to prevent this from happening again.

1 Like

Thanks looks like it is indeed working again!

Added logs

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.