Comment Comment by codexon I never said offloading was impossible. It will result in a large slowdown.It would look bad for cerebras if other people are hosting the 27b version and show a higher TPS than cerebras. parent codexon 1 month ago
It would look bad for cerebras if other people are hosting the 27b version and show a higher TPS than cerebras.