How do I request / set up a GPU server/. I don’t need it all day, just for specific heavy lifting tasks.
Fly GPU was a failed experiment and is no longer available. Try using runpod or modal instead
You can create a machine on the console using flyctl, and it is here that you specify a GPU. Don’t forget to destroy machines when you no longer need them.
Fly’s communication sucks. Iirc they said that then followed up with another post saying they’re deprecating it August 1st.
Urgh, here is a mention:
I wonder if Fly is keeping the announcement fairly quiet, as it will unavoidably let down some customers, who will have unplanned engineering work to plug the gap.
(To be fair, deprecation does/should not mean removal. I assume that come August, they will not be available for new customers, not that existing customers will be cut off entirely).
this deprecation was fairly quiet, yes; we have a very small amount of GPU users, and affected customers were contacted directly, as well as adding notes on the docs.
@lillian: I confess to being a bit unnerved by this post being “unlisted”. GPUs didn’t work out for Fly, that’s fine. Customers are a bit inconvenienced by having to shift products; that happens with experimental technologies. But I think transparency is important, mistakes and all.
Would you consider re-listing this?
yeah, that’s fair.