osquar
Joined 3 years ago
Karma
8
Submissions
20
Member since
Apr 19
Joined 3 years ago
I've never used any of the stuff you've released for free, but in the name of those who did use it -thank you
Surely, the cost of serving search results to bots isn't that high
1. Prompt hygiene (schema over prose, make no mistake) 2. Cache whenever you can 3. Context hygiene (seriously, start a new chat, it doesn't take much) 4. Routing 5. Control max_tokens, be smart about RAG 6. Semantic caching
What works for you?