Comment Comment by testing22321 I see all these LLM posts about if a certain model can run locally on certain hardware and I don’t get it.What are you doing with these local models that run at x tokens/sec.Do you have the equivalent of ChatGPT running entirely locally? What do you do with it? Why? I honestly don’t understand the point or use case. parent testing22321 7 months ago
What are you doing with these local models that run at x tokens/sec.
Do you have the equivalent of ChatGPT running entirely locally? What do you do with it? Why? I honestly don’t understand the point or use case.