Comment Comment by 1ba9115454 I can't imagine this setup will get more than 1 token per second.I would love to see Deepseek running on premise with a decent TPS. parent 1ba9115454 1 year ago
I would love to see Deepseek running on premise with a decent TPS.