An update: We now allow having both a shared IPv4 and dedicated IPv4. This change should make it possible to switch to a shared IPv4 without downtime.
A note for anyone else following these instructions: I had to redeploy my app to get it working with the newly allocated shared IP.