This is an often requested feature on Early look: PostgreSQL on Fly. We want your opinions. — but as of right now there isn’t a way to automate this yet.
The usual method of pg_dump and pg_restore will of course work, and the GitHub - fly-apps/postgres-migrator: Fly app that works to streamline Postgres migrations. app makes this super-easy.