BenderV
Joined 13 years ago
Joined 13 years ago
I think, notably, one of the errors has been to name functions calls "tools"...
I guess that it's only a matter of finetuning.
LLM have lots of experience with bash so I get they figure out how to work with it. They don't have experience with custom tools you provide it.
And also, LLM "tools" as we know it need better design (to show states, dynamic actions).
Given both, AI with the right tools will outperform AI with generic and uncontrolled tool.
I've built a SWE agent too (for fun), check it out => https://github.com/myriade-ai/autocode
You are right that there is lots of way to measure this but quality comments is way harder to judge and we don't have quantity traffic info.
> I wish you luck in refining your differentiation. Can't agree more with you. It's about distribution (which Snowflake/Databricks/... have) or differentiation.
Still, chatting with your data is already working and useful for lots.
> Do you need an expert to verify if the answer from AI is correct?
If the underling data has a quality issue that is not obvious to a human, the AI will miss it too. Otherwise, the AI will correct it for you. But I would argue that it's highly probable that your expert would have missed it too... So, no, it's not a silver bullet yet, and the AI model often lacks enough context that humans have, and the capacity to take a step back.
> How is it time saved refining prompts instead of SQL?
I wouldn't call that "prompting". It's just a chat. I'm at least ~10x faster (for reasonable complex & interesting queries).
Over the past few weeks/months, I’ve been working on Autochat, a lightweight Python library designed to make building AI agents simple and intuitive.
The focus of Autochat is simplicity:
- Extend an AI assistant's functionality by adding Python functions directly, or even class.
- Hide all the complexities/particularities of the providers (openai, anthropic, …)
I’d love your feedback on this. If you’ve got ideas for features, use cases, or critiques, let me know!
Founder of myriade.ai
Contact me at benderville / at // google mailing platform