moonmagick

Gary Marcus is a broken clock

He's been saying LLMs wouldn't scale since GPT-3 came out

And yet we all use them every day

Who cares about tracing? Prolog can't be multi-threaded on a GPU, why is that even in the conversation lol

I employ ~10 devs, and have hired quite a few over the last few years

I have no interest in looking at their resume, the first thing I do is look to see if they have a Github and what they've done with it

My green bar on Github and open source contributions have gotten me everything in life. Money, jobs, contracts, community support, etc.

Do people realize that there are hundreds of AI agents interacting with each other right now as a swarm on X?

This advice could probably apply to an interesting swath of new startups

Well, I can't think of a lot of well balanced people I know remotely at his level of success. I don't think that this is because successful people are imbalanced as much as I think most people are pretty imbalanced in some way, and successful people are just far more scrutinized. One of the worst oppressions on all of us is that we all have to carry some individual shame for something that probably happened to us as children, and it can't be talked about since it is so easily weaponized. There is no incentive to move toward a mentally healthier society in these conditions, I don't think. I'm open to a better way, but this feels like the dangerous parts of cancel culture, since it basically enables hackers to destroy anyone with their personal life.

Initially it had some real problems. large context window-- but you can only paste 4k tokens into the UI, for example. It never seemed like anyone at Google was using it. NotebookLM is a great interface, though, with some nice bells and whistles, and finally shows what Gemini is capable of. However, Opus still has the best long context retrieval with the least hallucination from what I've tried.

3.5 Sonnet is fast, and that is very meaningful to iteration speed, but I find for the level of complexity I throw at it, it strings together really bad solutions compared to the more wholistic solutions I can work through with Opus. I use Sonnet for general knowledge and small questions because it seems to do very well with shorter problems and is more up-to-date on libraries.