Volume metrics

1

The metrics Metrics on Fly do not appear to be available through Prometheus. I don’t see any other related metrics.

1 Like
2

Just wanted to check in on this again. There’s very little visibility into volume use.

3

I can’t see volume metrics either

2 Likes
4

Broken for me too, fly_volume_used_pct just never finds anything:

$ curl https://api.fly.io/prometheus/$ORG/api/v1/query_range?step=30 -H "Authorization: Bearer $FLY_AUTH_SECRET" --data-urlencode 'query=max (fly_volume_used_pct)'; echo
{"status":"success","isPartial":false,"data":{"resultType":"matrix","result":[]}}

I can query Fly’s other metrics just fine:

$ FLY_AUTH_SECRET="$(flyctl auth token)"
$ ORG=example_changeme
$ curl https://api.fly.io/prometheus/$ORG/api/v1/query_range?step=30 -H "Authorization: Bearer $FLY_AUTH_SECRET" --data-urlencode 'query=max (pg_stat_activity_count)'; echo
{"status":"success","isPartial":false,"data":{"resultType":"matrix","result":[{"metric":{},"values":[[1659993512,"17"],[1659993542,"17"],[1659993572,"17"],[1659993602,"9"],[1659993632,"11"],[1659993662,"11"],[1659993692,"11"],[1659993722,"11"],[1659993752,"11"],[1659993782,"12"],[1659993812,"12"]]}]}}

See also Feature preview: Custom metrics - #26 by jerome

1 Like
6

Hi @Tv1, thanks for your report. Today we tracked down the bug that had caused the two fly_volume_* metrics to stop being published and fixed the issue, so this should be working again. Sorry for the inconvenience!

7

I still don’t get any results for a Prometheus query for fly_volume_used_pct or fly_volume_size_bytes

{
  "status": "success",
  "isPartial": false,
  "data": {
    "resultType": "matrix",
    "result": []
  }
}

The organization is tripoutside.

8

Sorry about that! The volume metrics stopped a few hours after we deployed the last fix due to a different internal bug we tracked down today. We just deployed another fix that should keep it up and running this time.

9

Works now, thanks!

10

It would be great to show fly_volume_used_pct and fly_volume_size_bytes on the dashboard metrics page.

11

We just launched a set of integrated Grafana dashboards at fly-metrics.net (see Preview: Managed Grafana Dashboards for Fly Apps), including a Volume Usage panel showing the volume metrics for your apps. Hope this is helpful!

1 Like