Comment

Comment by geuis

I've been running the unrestricted mixtral 8x7B model locally via llama.cpp. It's insanely refreshing compared to any ChatGPT models, Gemini, Llama, etc.

For one thing, and granted this is my own experience, that model is much better at coding than any of the others I've tried.

But going beyond that, if I need to do anything complicated that might hit the baked in filters on these other models I don't have to worry about it with mixtral. I'm not doing anything illegal btw. It's just that I'm an adult and don't need to use the bumper lane when I go bowling. I also approach any interaction with the thing knowing not to 100% trust it and to verify anything it says independently.

parent geuis 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton