Hi everyone,
I’m encountering an issue while following the Fly.io guide on scaling LLMs with Ollama (Scaling LLMs with Ollama). I’m trying to provision seed volumes but receive an error related to GPU access.
Issue Description:
Problem: While following the article to scale LLMs, I receive the error: “failed to provision seed volumes: failed to create volume: Your organization does not have enough trust to access GPU machines. Please contact billing@fly.io to remove the restriction.”
- Steps to Reproduce:
- Follow the instructions from the article.
- Encounter the error message.
- Expected Behavior: Provisioning should be successfully as outlined in the guide.
- Actual Behavior: Provisioning fails with the GPU access restriction error.
Error Details:
- Error Message: “failed to provision seed volumes: failed to create volume: Your organization does not have enough trust to access GPU machines. Please contact billing@fly.io to remove the restriction.”
- Request ID: 01J4VTQBXVB78S9VJD2WGA34X0-cdg
- Trace ID: 04190f4a46e8990434b018a848e61001
Request for Assistance:
Could someone provide guidance on how to resolve this GPU access restriction? If it requires Fly.io support intervention, please advise on the next steps.
Thank you for your assistance!
Best,
Kamel.
Adding the context of the article might help others understand your issue better. If there’s anything else you need, let me know!