Concurrency connection limits in fly.toml for machines recommended values?

Questions / Help
1

After I migrated my app to apps v2 (machines) i have noticed that brand new fly.toml file has

  [services.concurrency]
    type = "connections"
    hard_limit = 1000
    soft_limit = 1000

while docs mention much lower values

  [services.concurrency]
    type = "connections"
    hard_limit = 25
    soft_limit = 20

I have no idea how many connections my app can handle in reality. Docs mention it in conjunction with load balancing and auto scaling. I don’t think that auto scaling is applicable to machines (at least not yet?), so is this even relevant? What are the recommended defaults?

2

It’s still relevant for load balancing. How we use them is described in the docs: Load Balancing · Fly Docs

You’re correct on autoscaling not being available for apps v2 yet, we’re working on that. The limits have no meaning in that context for now.

We recommend sticking to the defaults set in the fly.toml for apps v2.

3

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.