Comment by verdverm

FWIW, Gemini / Vertex has this as well and lets you control the TTL. Billing is based on how long you keep the context

https://ai.google.dev/gemini-api/docs/caching?lang=python

Costs $1 / 1M / 1h