sudhirb
Joined 1 year ago
Karma
41
Submissions
35
Member since
Jun 19
Joined 1 year ago
for long agent sessions, I would expect a very high cache hit rate unless you're editing the system prompt, tools, or history between turns, or some turns take longer than the cache timeout
Interested to see what techniques in this area pull ahead and gain traction!
Also I believe this person runs the ISP I use (and I couldn't speak more highly of it - Andrews & Arnold).
https://www.astralcodexten.com/p/come-on-obviously-the-purpo...
Seems like pure profit-maximizing/greed!