hello, I have an app that’s set up as a reverse proxy. Every 5 mins or so I see a spike in p99 latency matched by a spike in server concurrency. Meanwhile, there’s no apparent increase in http traffic.
I’m trying to figure out what’s going on here. My theory is that the non-fly server I’m connecting to is the one being slow, so open connections start piling up on Fly. I guess I’m looking for a way to determine the source of the pileup. If the concurrency in fly is actually what’s causing the spike in latency, then I’d obviously lower my concurrency limits. But I just don’t know!
The server is nikola-proxy btw. Thank you!