In the fly.io GPU Quickstart guide, the following setup is described:
Distro: ubuntu:22.04
apt
dependencies: cuda-nvcc-12-2 libcublas-12-2 libcudnn8
These setup instructions are not up-to-date anymore, as the dependencies have now new names in the apt repositories.
For reference, this is what I used in my Dockerfile
. Iām not saying this is optimized, but maybe a good starting off point for people
FROM ubuntu:24.04
RUN apt-get update && apt-get -y install nvidia-cuda-toolkit libcublas12
CMD ["nvidia-smi"]