I have scaled an app to 5 computers. I want each connection to use a separate server.
[services.concurrency]
hard_limit = 1
soft_limit = 1
type = "requests"`
However, when I open only one connection, all 5 reach the hard limit. What can cause this?
2022-09-14T13:20:29.879 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.329 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.339 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.362 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.363 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.368 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.385 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.390 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.387 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.414 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.413 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.417 proxy[a383c5a0] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.419 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.423 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.423 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.423 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.428 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.436 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.436 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.442 proxy[a383c5a0] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.459 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.482 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.492 proxy[a383c5a0] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.494 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.508 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.533 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.537 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.553 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.568 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.583 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.597 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.645 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.768 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.777 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.899 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:30.926 proxy[bce7509b] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.311 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.486 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.511 proxy[d2e6b68d] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.514 proxy[a383c5a0] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.644 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:31.954 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:32.035 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:32.044 proxy[89bcb94f] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:32.060 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1
2022-09-14T13:20:32.073 proxy[ccd1e775] fra [warn] Instance reached connections hard limit of 1 ```