What is the URL you’re using after you setup the proxy? It should be a localhost URL with a port. It’s in the output of the proxy command.
One thing you could do for CI/CD is to use the release_command which runs an ephemeral machine in your app specifically for things like migrations: App configuration (fly.toml) · Fly Docs