wr
hn
Top
New
Best
Ask
Show
Jobs
Back
g
guess__who
Joined 3 months ago
Karma
-15
Submissions
5
Member since
Jul 28
View on Hacker News
Recent submissions
Comment · 3 months ago
Some harness (cc) injects system messages in the middle, this kills the cache as the model provider moves the system to the top and concatenate them together. Use homemade proxy, you will get same 99% hot rate with even cc.