Is not having to build a dockers image worth $100 a month? I do find server setup to be a pain but I think if I will use a model for a year, I can take the time(3-4 hours) to set it up. Only with constant switching of models would I use a service like this.
I never set up bigger models like LLAMA on servers. Other hacker news people can chime in.
I never set up bigger models like LLAMA on servers. Other hacker news people can chime in.