Slow response times?

Phoenix
20

We tracked down a bottleneck that might have been the cause of some of these. It’s hard to tell app by app, but we have found latency spikes between our edge proxies and app worker servers that run app VMs. These should have improved substantially over the last day.

If you’re getting weird latency spikes, check your app config concurrency setting to make sure it has type = "requests" defined like this:

  [services.concurrency]
    hard_limit = 500
    soft_limit = 250
    type = "requests"

If there’s no type defined, or it’s set to connections, your requests might get stuck waiting for a whole new TCP connection. requests will reuse an existing connection pool, which should help mitigate this problem.

2 Likes