Could not retrieve volume with id '46677':

I’m trying to run a simple Phoenix project like instruction in docs and failing several times. Currently, facing this error:

Postgres cluster frosty-dew-921-db is now attached to frosty-dew-921
? Would you like to deploy now? Yes
Deploying frosty-dew-921
==> Validating app configuration
--> Validating app configuration done
Services
TCP 80/443 ⇢ 8080
Error error connecting to docker: could not fulfill resource requirements: could not retrieve volume with id '46677':

This was a bug with our builder provisioned. I cleaned the builder up, would you mind giving it another try? Thank you for posting about it, I know this stuff is frustrating.

Thanks ,I’ll notify you.

Can’t remove app, face with this.

unhandled upstream service error: error renaming lv: error creating volume: Existing logical volume "app_113100_pg_data_46173" not found in volume group "data_0" : exit status 5

Application name:falling-dew-9808-db

Ahhh! Same bug. Will you give that another try?

Not yet, still same error:

unhandled upstream service error: error renaming lv: error creating volume: Existing logical volume "app_113100_pg_data_46173" not found in volume group "data_0" : exit status 5

I relaunch the application and face with this log:

2022-03-26T16:08:41Z runner[fefcb976] fra [info]Starting instance
2022-03-26T16:08:41Z runner[fefcb976] fra [info]Configuring virtual machine
2022-03-26T16:08:41Z runner[fefcb976] fra [info]Pulling container image
2022-03-26T16:08:44Z runner[fefcb976] fra [info]Unpacking image
2022-03-26T16:08:45Z runner[fefcb976] fra [info]Preparing kernel init
2022-03-26T16:08:46Z runner[fefcb976] fra [info]Configuring firecracker
2022-03-26T16:08:46Z runner[fefcb976] fra [info]Starting virtual machine
2022-03-26T16:08:46Z app[fefcb976] fra [info]Starting init (commit: 6f9865f)...
2022-03-26T16:08:46Z app[fefcb976] fra [info]Preparing to run: `/app/bin/server` as nobody
2022-03-26T16:08:46Z app[fefcb976] fra [info]2022/03/26 16:08:46 listening on [fdaa:0:55da:a7b:66:fefc:b976:2]:22 (DNS: [fdaa::3]:53)
2022-03-26T16:08:47Z app[fefcb976] fra [info]Reaped child process with pid: 552, exit code: 0
2022-03-26T16:08:49Z app[fefcb976] fra [info]ERROR! Config provider Config.Reader failed with:
2022-03-26T16:08:49Z app[fefcb976] fra [info]** (RuntimeError) environment variable SECRET_KEY_BASE is missing.
2022-03-26T16:08:49Z app[fefcb976] fra [info]You can generate one by calling: mix phx.gen.secret
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:685: :erl_eval.do_apply/6
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:446: :erl_eval.expr/5
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:123: :erl_eval.exprs/5
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:280: :elixir.recur_eval/3
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:265: :elixir.eval_forms/3
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/code.ex:656: Code.eval_string_with_error_handling/3
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config.ex:258: Config.__eval__!/3
2022-03-26T16:08:49Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config/reader.ex:86: Config.Reader.read!/2
2022-03-26T16:08:49Z app[fefcb976] fra [info]{"init terminating in do_boot",{#{'__exception__'=>true,'__struct__'=>'Elixir.RuntimeError',message=><<101,110,118,105,114,111,110,109,101,110,116,32,118,97,114,105,97,98,108,101,32,83,69,67,82,69,84,95,75,69,89,95,66,65,83,69,32,105,115,32,109,105,115,115,105,110,103,46,10,89,111,117,32,99,97,110,32,103,101,110,101,114,97,116,101,32,111,110,101,32,98,121,32,99,97,108,108,105,110,103,58,32,109,105,120,32,112,104,120,46,103,101,110,46,115,101,99,114,101,116,10>>},[{erl_eval,do_apply,6,[{file,"erl_eval.erl"},{line,685}]},{erl_eval,expr,5,[{file,"erl_eval.erl"},{line,446}]},{erl_eval,exprs,5,[{file,"erl_eval.erl"},{line,123}]},{elixir,recur_eval,3,[{file,"src/elixir.erl"},{line,280}]},{elixir,eval_forms,3,[{file,"src/elixir.erl"},{line,265}]},{'Elixir.Code',eval_string_with_error_handling,3,[{file,"lib/code.ex"},{line,656}]},{'Elixir.Config','__eval__!',3,[{file,"lib/config.ex"},{line,258}]},{'Elixir.Config.Reader','read!',2,[{file,"lib/config/reader.ex"},{line,86}]}]}}
2022-03-26T16:08:49Z app[fefcb976] fra [info]init terminating in do_boot ({,[{erl_eval,do_apply,6,[{_},{_}]},{erl_eval,expr,5,[{_},{_}]},{erl_eval,exprs,5,[{_},{_}]},{elixir,recur_eval,3,[{_},{_}]},{elixir,eval_forms,3,[{_},{_}]},{Elixir.Code,ev
2022-03-26T16:08:49Z app[fefcb976] fra [info]Crash dump is being written to: erl_crash.dump...done
2022-03-26T16:08:49Z app[fefcb976] fra [info]Main child exited normally with code: 1
2022-03-26T16:08:49Z app[fefcb976] fra [info]Reaped child process with pid: 573 and signal: SIGUSR1, core dumped? false
2022-03-26T16:08:49Z app[fefcb976] fra [info]Starting clean up.
2022-03-26T16:08:56Z runner[fefcb976] fra [info]Starting instance
2022-03-26T16:08:56Z runner[fefcb976] fra [info]Configuring virtual machine
2022-03-26T16:08:56Z runner[fefcb976] fra [info]Pulling container image
2022-03-26T16:08:56Z runner[fefcb976] fra [info]Unpacking image
2022-03-26T16:08:56Z runner[fefcb976] fra [info]Preparing kernel init
2022-03-26T16:08:57Z runner[fefcb976] fra [info]Configuring firecracker
2022-03-26T16:08:57Z runner[fefcb976] fra [info]Starting virtual machine
2022-03-26T16:08:57Z app[fefcb976] fra [info]Starting init (commit: 6f9865f)...
2022-03-26T16:08:57Z app[fefcb976] fra [info]Preparing to run: `/app/bin/server` as nobody
2022-03-26T16:08:57Z app[fefcb976] fra [info]2022/03/26 16:08:57 listening on [fdaa:0:55da:a7b:66:fefc:b976:2]:22 (DNS: [fdaa::3]:53)
2022-03-26T16:08:58Z app[fefcb976] fra [info]Reaped child process with pid: 551, exit code: 0
2022-03-26T16:08:59Z app[fefcb976] fra [info]ERROR! Config provider Config.Reader failed with:
2022-03-26T16:08:59Z app[fefcb976] fra [info]** (RuntimeError) environment variable SECRET_KEY_BASE is missing.
2022-03-26T16:08:59Z app[fefcb976] fra [info]You can generate one by calling: mix phx.gen.secret
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:685: :erl_eval.do_apply/6
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:446: :erl_eval.expr/5
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:123: :erl_eval.exprs/5
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:280: :elixir.recur_eval/3
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:265: :elixir.eval_forms/3
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/code.ex:656: Code.eval_string_with_error_handling/3
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config.ex:258: Config.__eval__!/3
2022-03-26T16:08:59Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config/reader.ex:86: Config.Reader.read!/2
2022-03-26T16:08:59Z app[fefcb976] fra [info]init terminating in do_boot ({,[{erl_eval,do_apply,6,[{_},{_}]},{erl_eval,expr,5,[{_},{_}]},{erl_eval,exprs,5,[{_},{_}]},{elixir,recur_eval,3,[{_},{_}]},{elixir,eval_forms,3,[{_},{_}]},{Elixir.Code,ev
,75,69,89,95,66,65,83,69,32,105,115,32,109,105,115,115,105,110,103,46,10,89,111,117,32,99,97,110,32,103,101,110,101,114,97,116,101,32,111,110,101,32,98,121,32,99,97,108,108,105,110,103,58,32,109,105,120,32,112,104,120,46,103,101,110,46,115,101,99,114,101,116,10>>},[{erl_eval,do_apply,6,[{file,"erl_eval.erl"},{line,685}]},{erl_eval,expr,5,[{file,"erl_eval.erl"},{line,446}]},{erl_eval,exprs,5,[{file,"erl_eval.erl"},{line,123}]},{elixir,recur_eval,3,[{file,"src/elixir.erl"},{line,280}]},{elixir,eval_forms,3,[{file,"src/elixir.erl"},{line,265}]},{'Elixir.Code',eval_string_with_error_handling,3,[{file,"lib/code.ex"},{line,656}]},{'Elixir.Config','__eval__!',3,[{file,"lib/config.ex"},{line,258}]},{'Elixir.Config.Reader','read!',2,[{file,"lib/config/reader.ex"},{line,86}]}]}}
2022-03-26T16:08:59Z app[fefcb976] fra [info]init terminating in do_boot ({,[{erl_eval,do_apply,6,[{_},{_}]},{erl_eval,expr,5,[{_},{_}]},{erl_eval,exprs,5,[{_},{_}]},{elixir,recur_eval,3,[{_},{_}]},{elixir,eval_forms,3,[{_},{_}]},{Elixir.Code,ev
2022-03-26T16:08:59Z app[fefcb976] fra [info]Crash dump is being written to: erl_crash.dump...done
2022-03-26T16:09:00Z app[fefcb976] fra [info]Main child exited normally with code: 1
2022-03-26T16:09:00Z app[fefcb976] fra [info]Reaped child process with pid: 572 and signal: SIGUSR1, core dumped? false
2022-03-26T16:09:00Z app[fefcb976] fra [info]Starting clean up.
2022-03-26T16:09:06Z runner[fefcb976] fra [info]Starting instance
2022-03-26T16:09:06Z runner[fefcb976] fra [info]Configuring virtual machine
2022-03-26T16:09:06Z runner[fefcb976] fra [info]Pulling container image
2022-03-26T16:09:07Z runner[fefcb976] fra [info]Unpacking image
2022-03-26T16:09:07Z runner[fefcb976] fra [info]Preparing kernel init
2022-03-26T16:09:08Z runner[fefcb976] fra [info]Configuring firecracker
2022-03-26T16:09:08Z runner[fefcb976] fra [info]Starting virtual machine
2022-03-26T16:09:08Z app[fefcb976] fra [info]Starting init (commit: 6f9865f)...
2022-03-26T16:09:08Z app[fefcb976] fra [info]Preparing to run: `/app/bin/server` as nobody
2022-03-26T16:09:08Z app[fefcb976] fra [info]2022/03/26 16:09:08 listening on [fdaa:0:55da:a7b:66:fefc:b976:2]:22 (DNS: [fdaa::3]:53)
2022-03-26T16:09:09Z app[fefcb976] fra [info]Reaped child process with pid: 551, exit code: 0
2022-03-26T16:09:11Z app[fefcb976] fra [info]ERROR! Config provider Config.Reader failed with:
2022-03-26T16:09:11Z app[fefcb976] fra [info]** (RuntimeError) environment variable SECRET_KEY_BASE is missing.
2022-03-26T16:09:11Z app[fefcb976] fra [info]You can generate one by calling: mix phx.gen.secret
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:685: :erl_eval.do_apply/6
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:446: :erl_eval.expr/5
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (stdlib 3.16) erl_eval.erl:123: :erl_eval.exprs/5
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:280: :elixir.recur_eval/3
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (elixir 1.12.0) src/elixir.erl:265: :elixir.eval_forms/3
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/code.ex:656: Code.eval_string_with_error_handling/3
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config.ex:258: Config.__eval__!/3
2022-03-26T16:09:11Z app[fefcb976] fra [info]    (elixir 1.12.0) lib/config/reader.ex:86: Config.Reader.read!/2
2022-03-26T16:09:11Z app[fefcb976] fra [info]0,89,111,117,32,99,97,110,32,103,101,110,101,114,97,116,101,32,111,110,101,32,98,121,32,99,97,108,108,105,110,103,58,32,109,105,120,32,112,104,120,46,103,101,110,46,115,101,99,114,101,116,10>>},[{erl_eval,do_apply,6,[{file,"erl_eval.erl"},{line,685}]},{erl_eval,expr,5,[{file,"erl_eval.erl"},{line,446}]},{erl_eval,exprs,5,[{file,"erl_eval.erl"},{line,123}]},{elixir,recur_eval,3,[{file,"src/elixir.erl"},{line,280}]},{elixir,eval_forms,3,[{file,"src/elixir.erl"},{line,265
2022-03-26T16:09:11Z app[fefcb976] fra [info]0,89,111,117,32,99,97,110,32,103,101,110,101,114,97,116,101,32,111,110,101,32,98,121,32,99,97,108,108,105,110,103,58,32,109,105,120,32,112,104,120,46,103,101,110,46,115,101,99,114,101,116,10>>},[{erl_eval,do_apply,6,[{file,"erl_eval.erl"},{line,685}]},{erl_eval,expr,5,[{file,"erl_eval.erl"},{line,446}]},{erl_eval,exprs,5,[{file,"erl_eval.erl"},{line,123}]},{elixir,recur_eval,3,[{file,"src/elixir.erl"},{line,280}]},{elixir,eval_forms,3,[{file,"src/elixir.erl"},{line,265
]},{'Elixir.Code',eval_string_with_error_handling,3,[{file,"lib/code.ex"},{line,656}]},{'Elixir.Config','__eval__!',3,[{file,"lib/config.ex"},{line,258}]},{'Elixir.Config.Reader','read!',2,[{file,"lib/config/reader.ex"},{line,86}]}]}}
2022-03-26T16:09:11Z app[fefcb976] fra [info]Crash dump is being written to: erl_crash.dump...done
2022-03-26T16:09:11Z app[fefcb976] fra [info]Main child exited normally with code: 1
2022-03-26T16:09:11Z app[fefcb976] fra [info]Reaped child process with pid: 572 and signal: SIGUSR1, core dumped? false
2022-03-26T16:09:11Z app[fefcb976] fra [info]Starting clean up.

What version of Phoenix are you using?

fly launch sets a SECRET_KEY_BASE for you if you’re using Phoenix > 1.6.3. For earlier versions of Phoenix, you’ll need to do a bit of configuration by hand. Here is our guide for that: Deploy an Elixir Phoenix Application (pre v1.6.3)

Erlang/OTP 24 [erts-12.1] [source] [64-bit] [smp:4:4] [ds:4:4:10] [async-threads:1] [jit]

IEx 1.12.0 (compiled with Erlang/OTP 22)

  {:phoenix, "~> 1.6.6"},
  {:phoenix_ecto, "~> 4.4"},
  {:ecto_sql, "~> 3.6"},

I do launch project yesterday and it worked, but today it’s not working either with empty project.
set SECRET_KEY_BASE manually but some error happened:

1 desired, 1 placed, 0 healthy, 1 unhealthy [health checks: 1 total, 1 critical]
v1 failed - Failed due to unhealthy allocations - no stable job version to auto revert to
Failed Instances

==> Failure #1

Instance
  ID            = 9bc73d5b             
  Process       =                      
  Version       = 1                    
  Region        = fra                  
  Desired       = run                  
  Status        = running              
  Health Checks = 1 total, 1 critical  
  Restarts      = 0                    
  Created       = 4m54s ago            

Recent Events
TIMESTAMP            TYPE       MESSAGE                 
2022-03-26T16:13:09Z Received   Task received by client 
2022-03-26T16:13:09Z Task Setup Building Task Directory 
2022-03-26T16:13:17Z Started    Task started by client  

Recent Logs
2022-03-26T16:13:15.000 [info] Unpacking image
2022-03-26T16:13:16.000 [info] Preparing kernel init
2022-03-26T16:13:17.000 [info] Configuring firecracker
2022-03-26T16:13:17.000 [info] Starting virtual machine
2022-03-26T16:13:17.000 [info] Starting init (commit: 6f9865f)...
2022-03-26T16:13:17.000 [info] Preparing to run: `/app/bin/server` as nobody
2022-03-26T16:13:17.000 [info] 2022/03/26 16:13:17 listening on [fdaa:0:55da:a7b:23c4:9bc7:3d5b:2]:22 (DNS: [fdaa::3]:53)
2022-03-26T16:13:18.000 [info] Reaped child process with pid: 551, exit code: 0
2022-03-26T16:13:20.000 [info] 16:13:20.142 [info] Running TypsenseLiveviewPocWeb.Endpoint with cowboy 2.9.0 at :::4000 (http)
2022-03-26T16:13:20.000 [info] 16:13:20.145 [info] Access TypsenseLiveviewPocWeb.Endpoint at http://example.com:443
2022-03-26T16:13:20.000 [info] Reaped child process with pid: 572 and signal: SIGUSR1, core dumped? false
***v1 failed - Failed due to unhealthy allocations - no stable job version to auto revert to and deploying as v2 

Troubleshooting guide at https://fly.io/docs/getting-started/troubleshooting/
Error abort

fly secrets list
NAME            DIGEST                           DATE       
DATABASE_URL    355f544934dfa47b067b93118bc4a902 21m8s ago  
SECRET_KEY_BASE 1aca6bdc8822ef7b90facea7fd5e5f69 14m41s ago