Receiving `ERROR stderr to vsock zero copy err: Broken pipe (os error 32)`

Questions / Help
1

Hi all!

I’m trying to deploy a new rust web api to fly, and I’m seeing my pods continuously restarting with the following error
ERROR stderr to vsock zero copy err: Broken pipe (os error 32)

I’ve seen a number of other posts with this issue, but haven’t seen any resolution yet. Seems like the issue is related to stderr failing to connect to vsock in firecracker, so I’m assuming that this is a platform issue. Has anyone found a workaround?

Here’s my fly.toml

# fly.toml app configuration file generated for deal-server on 2024-10-13T21:22:45-04:00
#
# See https://fly.io/docs/reference/configuration/ for information about how to use this file.
#

app = 'deal-server'
primary_region = 'iad'
kill_signal = 'SIGINT'
kill_timeout = '5s'

[build]
  dockerfile = 'Dockerfile.prod'

[http_service]
  internal_port = 8080
  auto_stop_machines = 'off'
  auto_start_machines = true
  min_machines_running = 0
  processes = ['app']

[[services]]
  protocol = ''
  internal_port = 0

  [[services.ports]]
    port = 80
    handlers = ['http']
    force_https = true

  [[services.ports]]
    port = 443
    handlers = ['tls', 'http']

  [services.concurrency]
    type = 'connections'
    hard_limit = 25
    soft_limit = 20

  [[services.tcp_checks]]
    interval = '15s'
    timeout = '2s'
    grace_period = '1s'

  [[services.http_checks]]
    interval = '10s'
    timeout = '2s'
    grace_period = '5s'
    method = 'get'
    path = '/health'
    protocol = 'http'
    tls_skip_verify = false

[[vm]]
  memory = '1gb'
  cpu_kind = 'shared'
  cpus = 1

Thanks in advance!

2

This issue seems to persist across at least the bos, iad, cdg zones

3

This is potentially related using debian bullseye-slim as the base of the runtime in the Dockerfile

4

Yup confirmed - switching the image to debian:latest resolves the deployment issue

1 Like
5

Looks like this fix was temporary - my app has started crashing again. Looks like any error will crash the app entirely

6

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.