Adding the following to your dockerfile should fix this:
ENV RAILS_SERVE_STATIC_FILES="true"
To be clear, the message you were seeing is harmless, and is a bug that will be fixed shortly. As an alternative, you can disable having fly.io serve your static files and enable your Rails app to do so.