"Elixir Llama2-13b on Fly GPUs" doesn't work on new account?

1

I created a new Pay As You Go account, then followed this tutorial Dockerfile · GitHub.

After fly apps create myapp-gpu-llama13, set fly.toml and app.exs. Ran fly deploy. Eventually I get Error: failed to list VMs even after retries: request returned non-2xx status, 504 (Request ID: 01J7P7KENHS976JWJH9F1X53RP-ewr) (Trace ID: fd26036482cb906149b7a97dd9321db7)

Any clues?

2

Hm, probably related to this notification I just saw appear.

CleanShot 2024-09-13 at 13.49.33@2x
CleanShot 2024-09-13 at 13.49.33@2x1844×624 35.7 KB

3

It’s working now. I just need to request access to GPU.

4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.