I’m trying to play around with my app and see if I can force it to scale, however I’ve had no luck. Here is my services configuration:
[[services]]
internal_port = 5000
protocol = "tcp"
[services.concurrency]
hard_limit = 25
soft_limit = 20
[[services.ports]]
handlers = ["http"]
port = "80"
[[services.ports]]
handlers = ["tls", "http"]
port = "443"
[[services.tcp_checks]]
grace_period = "1s"
interval = "10s"
port = "5000"
restart_limit = 5
timeout = "2s"
I then ran ab -n 10000 -c 100 MY_URL
and constantly checked flyctl status
but it always stayed at 1. I have the following scaling plan set up
Scale Mode: Balanced
Min Count: 1
Max Count: 3
Am I testing incorrectly, or is something wrong?
EDIT: At first I thought maybe I’m getting cached responses or something but in my logging service I see over 50k logs. Oddly enough in the Fly metrics I’m not seeing any high number of responses though