mark_l_watson
Joined 17 years ago
Joined 17 years ago
I mostly use local models. I use pi with the strongest models my 64g mac can handle, and for fast light work I use ‘pool’ with Laguna 2.1 XS 6 bit quant. I am happy :-)
The food industry in the US is pretty much messed up. We try to only buy fresh produce and fresh fish, staying away from processed food - but it is difficult. I read something about the composition of the modern Butter Finger candy bar (fake chocolate, lots is chemically processed seed oils) compared to the almost wholesome ingredients used 30 or 40 years ago.
Finally, Apple has a great tool called ScreenTime that I can set limits on HN, YouTube, etc. I set a 15 minutes a day limit for each, but I can always add 15 minute increments if I find a good rabbit hole to explore.
I suspect that I am slightly more productive in VSCode for large code bases, but it just makes me feel happier and content to use Emacs.
My hunch is that Google will end up being best for non coding tasks. Google can concede coding to other vendors who pay Google for infra.
AI should make us better, not just churn out trillions of lines of code.
The very idea of massive vibe coding efforts, where devs go to sleep with a hoard of agents churning away, makes me uncomfortable.
Literally everything I do is Open Source software and Open Content writing so I am fine with the lack of privacy using direct Chinese APIs. And, for a little more spend, just use US companies like Fireworks.ai or Ollama Cloud for more privacy, or run on-premise locally and get the best grade of privacy.
I think NVIDIA does want small open models running on-prem to explode as a market! Lots of smaller GPU installations for companies who wisely want on-prem inference.
Of course NVIDIA will also keep making a ton of money selling to hyper scalers, but not forever: Chinese chips are getting better, Google, Microsoft, Amazon, etc. designing their own inference chips.
NVIDIA is handling this brilliantly.
That said, after being satisfied with Poolside.ai’s Laguna XS 2.1 4 bit quant, when I upgraded to a 64G Mac, I now only run the 6 bit quant and the results are better.
Unfortunately, I think that benchmarks are not useful for me, and I need to take time seeing what works for me: this is one reason that when I find a combination of model, harness, etc. that works for me, then I tend to use it for a month or two before looking around for new stuff.
My recent books can be read for free online on my web site or optionally you can pay for them at https://leanpub.com/u/markwatson
Twitter: mark_l_watson and Mastodon: @[email protected]