Later, after five consecutive quiet days, the registry became overloaded, and a nearly simultaneous builder capacity crunch led to considerable comment in the forum…
| incid. date |
pub. date |
description |
|---|---|---|
| 07/09 | 07/16 | A couple of deployment issues (Depot, registry) |
The registry half was resolved with a tiny droplet of forum lore: “our TAP interfaces, for one reason or another, start to struggle a bit under higher ultilization (> 1Gbps)”. This unintended networking bottleneck has been a kind of folknerd knowledge for a while, but the above, to the best of my recollection, is its first appearance in the official record.
Similarly with the useful plumbing fact that “machines can auto-migrate on start when capacity error happens, but this is explicitly not enabled for machines and volumes as large as builders.”
Moreover, there are details on planned improvements to the Depot builder infrastructure, moving closer to the “authoritative fix” that many well wishers have been hoping for…