Launch/Deploy is failing - Error remote builder app unavailable

New to this service and trying it out. I followed the directions to launch or deploy and I get this:

$ fly launch
An existing fly.toml file was found for app [removed for this post]
App is not running, deploy...
Deploying [removed for this post]
==> Validating app configuration
--> Validating app configuration done
Services
TCP 80/443 ⇢ 8080
WARN Remote builder did not start in time. Check remote builder logs with `flyctl logs -a fly-builder-damp-wildflower-3830`
Error remote builder app unavailable

I understand there was some problems yesterday with deploying, so I’m wondering if it could be related. Any help is appreciated.

Hey,

It may be a consequence of those issues :thinking:.

What you could do is try deleting that remote builder. Then on your next deploy, a new remote builder will be started (as you won’t have one), free of any issues left from yesterday.

Run fly destroy fly-builder-damp-wildflower-3830 (that seems to be the name of your stuck builder app).

And then do another deploy. And hopefully that one will then work.

That worked! Thank you for your help, kind sir.

1 Like

Let us know if the issue returns!

If so, please try out a deploy with debug mode on and let us know what errors you spot (if any):

LOG_LEVEL=debug fly deploy

Hi @fideloper-fly

I did actually run this when I was having my problem but I couldn’t discern anything from it. If it may help you though, here was the output:

$ LOG_LEVEL=debug fly launch
DEBUG Loaded flyctl config from/home/ubuntu/.fly/config.yml
DEBUG determined hostname: "ip-172-31-21-219"
DEBUG determined working directory: "/home/ubuntu/environment"
DEBUG determined user home directory: "/home/ubuntu"
DEBUG determined config directory: "/home/ubuntu/.fly"
DEBUG ensured config directory exists.
DEBUG ensured config directory perms.
DEBUG cache loaded.
DEBUG config initialized.
DEBUG initialized task manager.
DEBUG skipped querying for new release
DEBUG client initialized.
DEBUG Working Directory: /home/ubuntu/environment
DEBUG App Config File: 
An existing fly.toml file was found for app [REMOVED]
DEBUG --> POST https://api.fly.io/graphql

{
  "query": "query($appName: String!, $showCompleted: Boolean!) { appstatus:app(name: $appName) { id name deployed status hostname version appUrl organization { slug } deploymentStatus { id status version description placedCount promoted desiredCount healthyCount unhealthyCount } allocations(showCompleted: $showCompleted) { id idShort version latestVersion status desiredStatus totalCheckCount passingCheckCount warningCheckCount criticalCheckCount createdAt updatedAt canary region restarts healthy privateIP taskName checks { status output name } } } }",
  "variables": {
    "appName": "[REMOVED]",
    "showCompleted": false
  }
}

DEBUG {}
DEBUG <-- 200 https://api.fly.io/graphql (81.7ms)

{
  "data": {
    "appstatus": {
      "id": "[REMOVED]",
      "name": "[REMOVED]",
      "deployed": false,
      "status": "pending",
      "hostname": "[REMOVED].fly.dev",
      "version": 0,
      "appUrl": null,
      "organization": {
        "slug": "personal"
      },
      "deploymentStatus": null,
      "allocations": []
    }
  }
}
App is not running, deploy...
Deploying [REMOVED]
==> Validating app configuration
DEBUG --> POST https://api.fly.io/graphql

{
  "query": "query($appName: String!, $definition: JSON!) { app(name: $appName) { parseConfig(definition: $definition) { definition valid errors services { description } } } }",
  "variables": {
    "appName": "[REMOVED]",
    "definition": {
      "env": {
        "PORT": "8080"
      },
      "experimental": {
        "allowed_public_ports": [],
        "auto_rollback": true
      },
      "kill_signal": "SIGINT",
      "kill_timeout": 5,
      "processes": [],
      "services": [
        {
          "concurrency": {
            "hard_limit": 25,
            "soft_limit": 20,
            "type": "connections"
          },
          "http_checks": [],
          "internal_port": 8080,
          "ports": [
            {
              "force_https": true,
              "handlers": [
                "http"
              ],
              "port": 80
            },
            {
              "handlers": [
                "tls",
                "http"
              ],
              "port": 443
            }
          ],
          "processes": [
            "app"
          ],
          "protocol": "tcp",
          "script_checks": [],
          "tcp_checks": [
            {
              "grace_period": "1s",
              "interval": "15s",
              "restart_limit": 0,
              "timeout": "2s"
            }
          ]
        }
      ]
    }
  }
}

DEBUG {}
DEBUG <-- 200 https://api.fly.io/graphql (256.35ms)

{
  "data": {
    "app": {
      "parseConfig": {
        "definition": {
          "kill_timeout": 5,
          "kill_signal": "SIGINT",
          "processes": [],
          "experimental": {
            "allowed_public_ports": [],
            "auto_rollback": true
          },
          "services": [
            {
              "processes": [
                "app"
              ],
              "protocol": "tcp",
              "internal_port": 8080,
              "concurrency": {
                "soft_limit": 20,
                "hard_limit": 25,
                "type": "connections"
              },
              "ports": [
                {
                  "port": 80,
                  "handlers": [
                    "http"
                  ],
                  "force_https": true
                },
                {
                  "port": 443,
                  "handlers": [
                    "tls",
                    "http"
                  ]
                }
              ],
              "tcp_checks": [
                {
                  "interval": "15s",
                  "timeout": "2s",
                  "grace_period": "1s",
                  "restart_limit": 0
                }
              ],
              "http_checks": [],
              "script_checks": []
            }
          ],
          "env": {
            "PORT": "8080"
          }
        },
        "valid": true,
        "errors": [],
        "services": [
          {
            "description": "TCP 80/443 ⇢ 8080"
          }
        ]
      }
    }
  }
}
--> Validating app configuration done
Services
TCP 80/443 ⇢ 8080
DEBUG trying remote docker daemon
DEBUG Trying 'Buildpacks' strategy
DEBUG --> POST https://api.fly.io/graphql

{
  "query": "mutation($input: EnsureMachineRemoteBuilderInput!) { ensureMachineRemoteBuilder(input: $input) { machine { id state ips { nodes { family kind ip } } }, app { name organization { id slug } } } }",
  "variables": {
    "input": {
      "appName": "[REMOVED]",
      "organizationId": null
    }
  }
}

DEBUG {}
DEBUG <-- 200 https://api.fly.io/graphql (712.54ms)

{
  "data": {
    "ensureMachineRemoteBuilder": {
      "machine": {
        "id": "e286076fe20286",
        "state": "started",
        "ips": {
          "nodes": [
            {
              "family": "v6",
              "kind": "public",
              "ip": "2605:4c40:208:83f5:0:cbb:5ba6:1"
            },
            {
              "family": "v4",
              "kind": "private",
              "ip": "172.19.12.18"
            },
            {
              "family": "v6",
              "kind": "privatenet",
              "ip": "fdaa:0:ac38:a7b:a062:cbb:5ba6:2"
            }
          ]
        }
      },
      "app": {
        "name": "fly-builder-damp-wildflower-3830",
        "organization": {
          "id": "ZRJPoxp8kwJ0ZuKLVmgJ2ZQ1bJHDPOMlP",
          "slug": "personal"
        }
      }
    }
  }
}
DEBUG checking ip &{Family:v6 Kind:public IP:2605:4c40:208:83f5:0:cbb:5ba6:1 MaskSize:0}
Waiting for remote builder fly-builder-damp-wildflower-3830... 🌍 DEBUG checking ip &{Family:v4 Kind:private IP:172.19.12.18 MaskSize:0}
DEBUG checking ip &{Family:v6 Kind:privatenet IP:fdaa:0:ac38:a7b:a062:cbb:5ba6:2 MaskSize:0}
DEBUG --> POST https://api.fly.io/graphql

{
  "query": "query ($appName: String!) { appbasic:app(name: $appName) { id name platformVersion organization { id slug } } }",
  "variables": {
    "appName": "[REMOVED]"
  }
}

DEBUG {}
DEBUG <-- 200 https://api.fly.io/graphql (81.8ms)

{
  "data": {
    "appbasic": {
      "id": "[REMOVED]",
      "name": "[REMOVED]",
      "platformVersion": null,
      "organization": {
        "id": "ZRJPoxp8kwJ0ZuKLVmgJ2ZQ1bJHDPOMlP",
        "slug": "personal"
      }
    }
  }
}
DEBUG --> POST https://api.fly.io/graphql

{
  "query": "mutation($input: ValidateWireGuardPeersInput!) { validateWireGuardPeers(input: $input) { invalidPeerIps } }",
  "variables": {
    "input": {
      "peerIps": [
        "fdaa:0:ac38:a7b:ce2:0:a:2"
      ]
    }
  }
}

DEBUG {}
DEBUG <-- 200 https://api.fly.io/graphql (121.4ms)

{
  "data": {
    "validateWireGuardPeers": {
      "invalidPeerIps": []
    }
  }
}
Waiting for remote builder fly-builder-damp-wildflower-3830... 🌍 DEBUG Remote builder unavailable, retrying in 50ms (err: Get "http://[fdaa:0:ac38:a7b:a062:cbb:5ba6:2]:2375/_ping": context deadline exceeded)
WARN Remote builder did not start in time. Check remote builder logs with `flyctl logs -a fly-builder-damp-wildflower-3830`
DEBUG result image:<nil> error:remote builder app unavailable
Error remote builder app unavailable