Comment by mzl

It is tricky to build good infrastructure for prompt caching.