Comment

Comment by martinald

I wrote about this a couple of weeks ago. It's actually often the biggest cost and it tends to be hidden away on most platforms!

https://martinalderson.com/posts/watch-out-for-cache-read-co...

Btw I still haven't came across any decent model that is <$0.01/MTok cache costs apart from deepseek thru their official API (even with the price increases).

Seems like a bit of an opportunity for someone to take - drop cache read costs significantly.

parent martinald 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton