cmcollier

The system one model idea is quite powerful, but it requires decomposing problems into very granular steps and questions.

This is a lot more work than basic zero or few shot prompting of a large general LLM. It's also a bit contrary to the challenge of an autonomous agent in an open ended environment.

It will take time for people to do that kind of work and apply these models in their domais. Similarly it will take time for someone to figure out how to potentially automate the decomposition process so they could be leveraged in more autonomous agents.

I'm curious to know what proportion of the training data at frontier model shops is composed of their scanned book text vs the internet.

Thanks! I did notice there are mixed stories about it working, and I got some email about it too. I'll check it out and make an update.

There's a lot of potential here. I'm hopeful this turns out well for the community of Abilene.

Writing code that runs down hole or otherwise connects back to the real world would be fun. Maybe I should pickup firmware skills. Good luck with your hiring!

For Vespa there's a managed version hosted by the Vespa company in their cloud environment, and then the open source version is easily run locally or in any environment of your choosing. It takes some attention to detail, but it's quite flexible. I have a long running single node instance on an Intel NUC, but I've also run more complex cluster variations across different cloud environments.