`fly ssh console` stops working after creating the app with a network

That’s right. You have to create the WG peer using the API (see Create app & add WireGuard peer via API and WireGuard peer on custom network). With the output of the API call, you can edit the wg conf.