Fly web app keeps redeploying

1

I have a repository that deploys via a CI hook on GitHub. I’m seeing Fly continuously redeploy the web application - every 10 minutes or so.

The worker app deployed from the same repositiory and CI hook doesn’t do this. Have revoked all access tokens (I got paranoid…) and this had no effect.

Screenshot 2022-08-10 at 16.36.18
Screenshot 2022-08-10 at 16.36.18574×1516 229 KB

Seeing moderately high traffic at the moment, but nothing that OTT.

Only other potentially unusual thing I can think of is that it used to be configured to run multiple processes (using the ‘processes’ section of fly.toml), but split the two processes into separate apps because I wanted autoscaling.

Any ideaa what’s going on?

2

That does seem a bit odd, thanks for calling it out. Off the bat, I don’t know what would cause that many restarts-- what do the logs for the app say?

You might also want to run fly vm status and fly info, to get a better overall view of the problem.

3

Can you post your GIthub CI config? Perhaps it’s picking up commits from a branch you didn’t intend to trigger a deployment from?

Also, it’s possible you had enabled autoscaling on your app. If so, you can disable it with fly autoscale disable, or adjust concurrency settings in fly.toml to trigger it on the right conditions for your app.

4

Thanks for the quick response! Autoscaling is enabled. Intentionally so as I’m expecting realtively spikey usage.

Does a new instance created due to hitting a concurrency threshold show up as a ‘deploy’ w/ a new app version? I hadn’t really considered that – if so, it might be that and I’ve misunderstood the terminology.

If that’s the case, and it’s frequently scaling up then down, does that mean I want my hard and soft concurrency limits to be closer together or further apart? It’s currently 20 soft, 30 hard.

Here’s my CI script. Presumably if it was something to do with that, my worker application would be getting redeployed as well, though…

name: Deploy / Production
on:
  push:
    branches:
      - main
env:
  FLY_API_TOKEN: ${{ secrets.FLY_API_TOKEN }}
jobs:
  deploy:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v2
      - uses: superfly/flyctl-actions/setup-flyctl@master
      - run: flyctl deploy --config fly.toml --remote-only
      - run: flyctl deploy --config fly.worker.toml --remote-only
5

Yeah, autoscaling will issue a new release. You’ll probably want to try different concurrency settings. Not necessarily further apart, but higher, if you feel that you don’t need scale for the amount of traffic that’s triggering it.

Note also that autoscaling does not behave well with process groups, in case you have enabled those at any point.

6

Makes sense, thanks. I used to have process groups, but removed them for that reason. There’s not likely to be any hangover effect from that is there?

7

I don’t think so. Are you able to share the app name?