If you run fly dashboard you will be taken to the dashboard. If you see an entry starting with fly-builder-, click on it, then on settings and from there you can delete the builder app.
Alternately, you can run fly apps list and if you see an entry that starts with fly-builder- you can delete that app using fly apps destroy.
No.