Make sure the [[services]] section of your Fly app is non-empty (ref).
You can allocate IPs for your app with flyctl (exec’ing which should auto add approp A / AAAA records for <app-name>.fly.dev): flyctl ips allocate v4 · Fly Docs | flyctl ips allocate v6 · Fly Docs