Running an LLM on Fly

Questions / Help
,
1

I am wanting to host an LLM on Fly and wanted to know if there is anything I should consider when it comes to resources, billing, or limitations I might face. The plan is to write the LLM in Go and the frontend be written in HTMX.

2

Check this out: https://www.youtube.com/watch?v=jM1PGrs6C_Y

1 Like
3

Thanks @mhostetler

1 Like
4

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.