Concurrent connections and scaling of servers

[w8emv]

This post from @merlin last year looks like it got a good answer about the ‘scaling up’ behavior of hard_limit vs soft_limit, for reference

Finding good [services.concurrency] settings without bringing down prod ;-)

Hi, first off, I really really appreciate you guys answering questions in the forum diligently! In fly.toml, is my understanding of the [services.concurrency] section correct? A concurrent request means 1 ongoing TCP request, which usually takes a couple seconds max. 25 concurrent requests, for example, mean 25 requests being handled at the same time (and probably sent roughly at the same time) How is this handled with WebSockets (and Long-Polling fallbacks)? And in terms of concurrent …

I’m afraid I didn’t find an equally lucid description of the “autoscale down” algorithm.