Fly released Automatically starting/stopping Apps v2 instances last month, so it’s now possible to scale to zero without needing the container’s entrypoint to exit.
They also released Setting a minimum number of instances to keep running when using auto start/stop a few days ago if you want to automatically scale down but to a number larger than 0.