Failed to fetch an image or build from source: failed building options: failed probing "personal": context deadline exceeded

Can no longer deploy :pray:

LOG_LEVEL=debug fly deploy
DEBUG Loaded flyctl config from/Users//.fly/config.yml
DEBUG determined hostname: “-0729”
DEBUG determined working directory: “/Users//apps/app/app”
DEBUG determined user home directory: “/Users/”
DEBUG determined config directory: “/Users//.fly”
DEBUG ensured config directory exists.
DEBUG ensured config directory perms.
DEBUG cache loaded.
DEBUG config initialized.
DEBUG initialized task manager.
DEBUG skipped querying for new release
DEBUG client initialized.
DEBUG → POST GraphQL Playground

{
“query”: “query ($appName: String!) { appbasic:app(name: $appName) { id name platformVersion organization { id slug } } }”,
“variables”: {
“appName”: “app”
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (200.2ms)

{
“data”: {
“appbasic”: {
“id”: “app”,
“name”: “app”,
“platformVersion”: “nomad”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
DEBUG app config loaded from /Users//apps/app/app/fly.toml
==> Verifying app config
→ Verified app config
==> Building image
DEBUG trying remote docker daemon
DEBUG Trying ‘Buildpacks’ strategy
DEBUG → POST GraphQL Playground

{
“query”: “mutation($input: EnsureMachineRemoteBuilderInput!) { ensureMachineRemoteBuilder(input: $input) { machine { id state ips { nodes { family kind ip } } }, app { name organization { id slug } } } }”,
“variables”: {
“input”: {
“appName”: “fire-be”,
“organizationId”: null
}
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (180.99ms)

{
“data”: {
“ensureMachineRemoteBuilder”: {
“machine”: {
“id”: “24d8907ebe7387”,
“state”: “started”,
“ips”: {
“nodes”: [
{
“family”: “v6”,
“kind”: “public”,
“ip”: “2605:4c40:243:16df:0:13bf:f28c:1”
},
{
“family”: “v4”,
“kind”: “private”,
“ip”: “172.19.13.186”
},
{
“family”: “v6”,
“kind”: “privatenet”,
“ip”: “fdaa:0:94c7:a7b:2cc3:13bf:f28c:2”
}
]
}
},
“app”: {
“name”: “fly-builder-ancient-waterfall-1377”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
}
DEBUG checking ip &{Family:v6 Kind:public IP:2605:4c40:243:16df:0:13bf:f28c:1 MaskSize:0}
DEBUG checking ip &{Family:v4 Kind:private IP:172.19.13.186 MaskSize:0}
DEBUG checking ip &{Family:v6 Kind:privatenet IP:fdaa:0:94c7:a7b:2cc3:13bf:f28c:2 MaskSize:0}
Waiting for remote builder fly-builder-ancient-waterfall-1377… :earth_africa: DEBUG → POST GraphQL Playground

{
“query”: “query ($appName: String!) { appbasic:app(name: $appName) { id name platformVersion organization { id slug } } }”,
“variables”: {
“appName”: “fire-be”
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (96.93ms)

{
“data”: {
“appbasic”: {
“id”: “fire-be”,
“name”: “fire-be”,
“platformVersion”: “nomad”,
“organization”: {
“id”: “3KXm0g39B6X2ZT01Nkv4g83lV4h0mbQAV”,
“slug”: “personal”
}
}
}
}
DEBUG → POST GraphQL Playground

{
“query”: “mutation($input: ValidateWireGuardPeersInput!) { validateWireGuardPeers(input: $input) { invalidPeerIps } }”,
“variables”: {
“input”: {
“peerIps”: [
“fdaa:0:94c7:a7b:8cfe:0:a:2”
]
}
}
}

DEBUG {}
DEBUG ← 200 GraphQL Playground (71.36ms)

{
“data”: {
“validateWireGuardPeers”: {
“invalidPeerIps”:
}
}
}
DEBUG result image: error:failed building options: failed probing “personal”: context deadline exceeded
Error failed to fetch an image or build from source: failed building options: failed probing “personal”: context deadline exceeded

Will you run fly apps delete fly-builder-ancient-waterfall-1377 and see if that helps? It’s not supposed to, but it might.

Done. Now it looks like the builder is actually “running” vs crashing, but I still can’t deploy.

Failed to fetch an image or build from source: failed building options: failed probing “personal”: context deadline exceeded

1 Like

So, am I SOL?

Off the bat, since this error points towards a connectivity issue, you might try running fly wireguard reset or fly wireguard websockets enable to see if that helps.

6 Likes

fly wireguard reset worked! Thanks @eli

4 Likes

We actually found the bug causing this. fly wireguard reset was a good workaround, but it shouldn’t come up again! Thanks for being patient.

2 Likes

I know this was just posted 15 days ago, but I did a fresh install using https://fly.io/install.sh today just now, and I got this same error:

{
  "data": {
    "validateWireGuardPeers": {                                                                                                                 "invalidPeerIps": []
    }
  }
}
DEBUG result image:<nil> error:failed building options: failed probing "personal": context deadline exceeded
Error failed to fetch an image or build from source: failed building options: failed probing "personal": context deadline exceeded

I tried fly wireguard reset and that didn’t fix the problem.

I tried fly wireguard websockets enable and it’s making progress building now.

1 Like

I was following a guide to deploy pocketbase docker to fly.io (Host for free on Fly.io · pocketbase/pocketbase · Discussion #537 · GitHub) but when I reached the deploy stage I had the same error:

The fly wireguard reset trick worked to let me deploy.

I was getting the context deadline exceeded error today.

I ran fly wireguard websockets enable and my app is correctly deploying…

I don’t think this is resolved. I deployed successfully once and then ran into this ...context deadline exceeded error on subsequent deploy and got round it with fly wireguard websockets enable.

The error appeared again on fly ssh console -C "rails/bin/rails console and again resolved with fly wireguard websockets enable.

I’ve run curl -L https://fly.io/install.sh | sh a couple of times since the first deploy to try to resolve some other issue I had (so maybe related as tirefire has alluded).

Daniel

Also seeing this today:

failed to fetch an image or build from source: {"message":"page not found"}
 (http: 404)

I am trying to deploy docker image and got this:

Error: failed to fetch an image or build from source: error connecting to docker: failed building
options: failed probing “personal”: context deadline exceeded

fly wireguard reset and fry wireguard websockets enable does not help.
What might be the problem?

1 Like

fly wireguard reset did the trick for me as well today. I had the probe failed issue as well.

1 Like

It didn’t help me… why again I have problems with deploy? Always problems…

I am facing an issue while deploying my Shopify app on fly.io.
The error is: Failed to start remote builder heartbeat: failed building options: failed probing "personal": context deadline exceeded I tried flyctl wireguard reset , flyctl wireguard websockets enable , fly wireguard reset , fly wireguard websockets enable and tried to remove peer list using flyctl wg list and flyctl wg remove
But they are not working for my case. Any idea?

1 Like