oesimania

There was a great paper around compiled AI (use LLM as compiler, not as runtime) that I really liked, but it's really hard to explain the benefit to people. This open source project should change that, giving everyone a chance to play around with it locally. You can create your own compiled ai plans, run them deterministically, and it also allows you to connect it to your agents so that if they have something where they can use less tokens or be more deterministic in the future they will.

We choose Rust btw bc it works so well for both agents and humans. The compiler alone is super helpful, it's like getting a development harness for free that you can just extend.

It's still more of a demo what it can do, so expect failures and quirks, but looking forward to feedback and how it's working for you

"You see the demos from our friends in the marketing departments, showing off how the same prompt for a sales report can give you a bulleted list one day and a haiku the next. Not what you want when you need to close the quarter." So, haiku is what they expect, right?