The following, more detailed version does work, last I heard:
https://community.fly.io/t/urgency-problems-with-postgres-the-database-is-not-responding/19926/2
(Probably it should be the official documentation…)
You override with a new user name but the old database name.