Comment Comment by lawrencechen Georgi just added support for all models (13B/33B/65B) [0]LLaMA 65B can do ~2 tokens per second on my M1 Max / 64 gb ram [1][0] https://twitter.com/ggerganov/status/1634488664150487041 [1] https://twitter.com/lawrencecchen/status/1634507648824676353 parent lawrencechen 3 years ago
LLaMA 65B can do ~2 tokens per second on my M1 Max / 64 gb ram [1]
[0] https://twitter.com/ggerganov/status/1634488664150487041 [1] https://twitter.com/lawrencecchen/status/1634507648824676353