How long are you running your test for? If you visit the UI (fly.io/apps/<name>/metrics) you can see the concurrency per VM. Scaling is based on metrics, so it’ll need to be maxed out for like 30-60s before you see a response.
Also what are your limits set to?