Failed to fetch an image or build from source: failed building options: failed probing "personal": context deadline exceeded

Can no longer deploy :pray:

LOG_LEVEL=debug fly deploy
DEBUG Loaded flyctl config from/Users//.fly/config.yml
DEBUG determined hostname: “-0729”
DEBUG determined working directory: “/Users//apps/app/app”
DEBUG determined user home directory: “/Users/”
DEBUG determined config directory: “/Users//.fly”
DEBUG ensured config directory exists.
DEBUG ensured config directory perms.
DEBUG cache loaded.
DEBUG config initialized.
DEBUG initialized task manager.
DEBUG skipped querying for new release
DEBUG client initialized.
DEBUG → POST GraphQL Playground

{
“query”: “query ($appName: String!) { appbasic:app(name: $appName) { id name platformVersion organization { id slug } } }”,
“variables”: {
“appName”: “app”
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (200.2ms)

{
“data”: {
“appbasic”: {
“id”: “app”,
“name”: “app”,
“platformVersion”: “nomad”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
DEBUG app config loaded from /Users//apps/app/app/fly.toml
==> Verifying app config
→ Verified app config
==> Building image
DEBUG trying remote docker daemon
DEBUG Trying ‘Buildpacks’ strategy
DEBUG → POST GraphQL Playground

{
“query”: “mutation($input: EnsureMachineRemoteBuilderInput!) { ensureMachineRemoteBuilder(input: $input) { machine { id state ips { nodes { family kind ip } } }, app { name organization { id slug } } } }”,
“variables”: {
“input”: {
“appName”: “fire-be”,
“organizationId”: null
}
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (180.99ms)

{
“data”: {
“ensureMachineRemoteBuilder”: {
“machine”: {
“id”: “24d8907ebe7387”,
“state”: “started”,
“ips”: {
“nodes”: [
{
“family”: “v6”,
“kind”: “public”,
“ip”: “2605:4c40:243:16df:0:13bf:f28c:1”
},
{
“family”: “v4”,
“kind”: “private”,
“ip”: “172.19.13.186”
},
{
“family”: “v6”,
“kind”: “privatenet”,
“ip”: “fdaa:0:94c7:a7b:2cc3:13bf:f28c:2”
}
]
}
},
“app”: {
“name”: “fly-builder-ancient-waterfall-1377”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
}
DEBUG checking ip &{Family:v6 Kind:public IP:2605:4c40:243:16df:0:13bf:f28c:1 MaskSize:0}
DEBUG checking ip &{Family:v4 Kind:private IP:172.19.13.186 MaskSize:0}
DEBUG checking ip &{Family:v6 Kind:privatenet IP:fdaa:0:94c7:a7b:2cc3:13bf:f28c:2 MaskSize:0}
Waiting for remote builder fly-builder-ancient-waterfall-1377… :earth_africa: DEBUG → POST GraphQL Playground

{
“query”: “query ($appName: String!) { appbasic:app(name: $appName) { id name platformVersion organization { id slug } } }”,
“variables”: {
“appName”: “fire-be”
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (96.93ms)

{
“data”: {
“appbasic”: {
“id”: “fire-be”,
“name”: “fire-be”,
“platformVersion”: “nomad”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
DEBUG → POST GraphQL Playground

{
“query”: “mutation($input: ValidateWireGuardPeersInput!) { validateWireGuardPeers(input: $input) { invalidPeerIps } }”,
“variables”: {
“input”: {
“peerIps”: [
“fdaa:0:94c7:a7b:8cfe:0:a:2”
]
}
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (71.36ms)

{
“data”: {
“validateWireGuardPeers”: {
“invalidPeerIps”:
}
}
}
DEBUG result image: error:failed building options: failed probing “personal”: context deadline exceeded
Error failed to fetch an image or build from source: failed building options: failed probing “personal”: context deadline exceeded

Will you run fly apps delete fly-builder-ancient-waterfall-1377 and see if that helps? It’s not supposed to, but it might.

Done. Now it looks like the builder is actually “running” vs crashing, but I still can’t deploy.

Failed to fetch an image or build from source: failed building options: failed probing “personal”: context deadline exceeded

1 Like

So, am I SOL?

Off the bat, since this error points towards a connectivity issue, you might try running fly wireguard reset or fly wireguard websockets enable to see if that helps.

3 Likes

fly wireguard reset worked! Thanks @eli

3 Likes

We actually found the bug causing this. fly wireguard reset was a good workaround, but it shouldn’t come up again! Thanks for being patient.

2 Likes

I know this was just posted 15 days ago, but I did a fresh install using https://fly.io/install.sh today just now, and I got this same error:

{
  "data": {
    "validateWireGuardPeers": {                                                                                                                 "invalidPeerIps": []
    }
  }
}
DEBUG result image:<nil> error:failed building options: failed probing "personal": context deadline exceeded
Error failed to fetch an image or build from source: failed building options: failed probing "personal": context deadline exceeded

I tried fly wireguard reset and that didn’t fix the problem.

I tried fly wireguard websockets enable and it’s making progress building now.

1 Like

I was following a guide to deploy pocketbase docker to fly.io (Host for free on Fly.io · Discussion #537 · pocketbase/pocketbase · GitHub) but when I reached the deploy stage I had the same error:

The fly wireguard reset trick worked to let me deploy.

I was getting the context deadline exceeded error today.

I ran fly wireguard websockets enable and my app is correctly deploying…

I don’t think this is resolved. I deployed successfully once and then ran into this ...context deadline exceeded error on subsequent deploy and got round it with fly wireguard websockets enable.

The error appeared again on fly ssh console -C "rails/bin/rails console and again resolved with fly wireguard websockets enable.

I’ve run curl -L https://fly.io/install.sh | sh a couple of times since the first deploy to try to resolve some other issue I had (so maybe related as tirefire has alluded).

Daniel

Also seeing this today:

failed to fetch an image or build from source: {"message":"page not found"}
 (http: 404)