Comment Comment by bugglebeetle Anthropic serves quantized versions of their models and you can run q8 locally. parent bugglebeetle 5 months ago
