Try putting CMD ["sleep", "infinity"] at the end of your Dockerfile. And put an empty [[services]] block in fly.toml.
CMD ["sleep", "infinity"]
[[services]]
fly.toml