It's honestly surprising how little work gets put into building harnesses which carefully steer the LLM through sophisticated context curation. Probably due to the belief that we shouldn't care much because AGI is just around the corner.
Related (but shameless) plug : I've actually been hacking a project over the past two weeks to address this very issue. I'd like to create an SDK which embeds the evaluation of LLMs into code seamlessly, and does "behind the curtains" context curation, to really enable "hybrid" code/LLM agentic applications. (if you're curious => https://github.com/VKCR/semiotique)
It's honestly surprising how little work gets put into building harnesses which carefully steer the LLM through sophisticated context curation. Probably due to the belief that we shouldn't care much because AGI is just around the corner.
Related (but shameless) plug : I've actually been hacking a project over the past two weeks to address this very issue. I'd like to create an SDK which embeds the evaluation of LLMs into code seamlessly, and does "behind the curtains" context curation, to really enable "hybrid" code/LLM agentic applications. (if you're curious => https://github.com/VKCR/semiotique)