Adding quickwit logs as data source in Grafana Cloud

[bembot90]

Is it possible to set up the quickwit logs data source in Grafana Cloud the same way that we can with the prometheus metrics as described here: Hooking Up Fly Metrics · The Fly Blog. When I try to add it using https://api.fly.io/quickwit/<org-name> it’s asking me to enter Index settings.

[ishands]

We were able to use the Fly Log Shipper to export logs to Loki on our Grafana Cloud instance.

In the article where they set the LOGTAIL_TOKEN, set these secrets instead:

fly secrets set LOKI_URL="https://logs-prod-xxxxxxx.grafana.net"
fly secrets set LOKI_USERNAME="12345678"
fly secrets set LOKI_PASSWORD="glc_xxxxx"

[bembot90]

Thanks. I was hoping the fly.io team would be able to provide the values they’re using for the Index settings so that I could connect to the quickwit service directly just like they are. I’ll try the Fly Log Shipper if that’s not an option.

[mayailurus]

I would go with @ishands’s answer, at this point. Last I heard, the Quickwit integration was slated to be removed—or at least re-thought rather drastically…

(Possibly replaced with something that just stores chunks of logs in S3 buckets. There’s a branch in the official flyctl repository that assumes such a structure, if I’m interpreting it correctly.)