Ladioss
Joined 6 years ago
Karma
187
Submissions
17
Member since
Apr 14
Joined 6 years ago
But more seriously, I can't help but be amused by how emotionally invested in their AI brand of choice people are getting.
Also you need to check your context size, Ollama default to 4K if <24 Gb of VRAM and you need 64K minimum if you want claude to be able to at least lift a finger.
* Mediocracy: The Politics of the Extreme Centre
* The Managerial Revolution
With the wealth of models available (open source vs closed, api vs local), I find optimizing the cost-efficiency of your token consumption an important part of business-oriented AI engineering. You don't need "the best" for every task.