I have an llm agent with a harness that stores/logs everything in a structured manner to local files and/or sqlite. This then turns more into casual conversation type stuff. Send it test results, talk about stuff, give it updates, etc, and it handles the rest. Querying the data is pretty straight-forward without the agent since it's plaintext/sqlite. I tried random tools over time but sorta fell out of them. This is kinda the only thing that's stuck.
Could take this further and make it better with structured tooling. Some sorta CLI perhaps, or an API, that the agent knows how to use, then can build a frontend on top or something. For now this works okay.
Could take this further and make it better with structured tooling. Some sorta CLI perhaps, or an API, that the agent knows how to use, then can build a frontend on top or something. For now this works okay.