Well, my instinct was right.
Found some guidance at gui for a postgres db on fly io - #4 by rookie, in that you can use fly postgres connect, but the app you pass via the -a flag is, somewhat confusingly, the -db suffixed “app”, instead of the actual app that you created the postgres instance for.