Comment by a_lifters_life

Im building a script for my own dev to spin up droplets on DigitalOcean to run high performing LLMs like H100 - this is all prompted through open web ui (ollama) . I find the models my 12GB GPU will tolerate have too many hallucinations - its ok for diffing for example or basic scripts, but anything somewhat complicated I need 60GB+ GPU which isnt feasible for me to buy..