itsderek23
Joined 17 years ago
Karma
999
Submissions
139
Member since
Aug 3
https://github.com/itsderek23/
View on Hacker NewsRecent submissions
Comment · 6 months ago
This worked well for me ... I pointed claude at https://agentgrade.com/skills.json and let it incrementally increase its score.
Comment · 7 months ago
How I'm using git/Github has changed with agentic coding. However, I'm not using swarms of agents to write code, so it's bit hard for me to decipher the JTBD of gitbutler.
Another take I've seen is https://agentrepo.com/, which is light-weighted hosted git that's easy for agents to use (no accounts, no API keys, public repos are free). There are large parts of the GitHub experience I'm no longer using (mostly driving from Claude), so I think this is an interesting take.
Comment · 3 years ago
Nice work! I'm working on a similar standalone DevOps AI Agent (OpsTower.ai). This post shows how the agent is structured and how it performs against a 40 question evaluation dataset: https://www.opstower.ai/2023-evaluating-ai-agents/
Comment · 3 years ago
Thanks!
> Did you hit token limits?
While i used TikToken to limit the message history (and keep below the token limit), generally I found that I didn't get better completions by putting a lot of data into the context. Usually the completions got more confusing. I put a limited amount of info into the context and have generally stayed below the token limit.
> Are you storing message/ chat histories between sessions
Right now, yes. It's pretty important to store everything (each request / response) to debug issues with prompt, context, and the agent call loop.
Comment · 6 years ago
+1. Jonathan is great to work with if you are in a similar position as Baremetrics.