Comment Comment by danilovilhena How does it deal with prompt caching? Do you have any resource for this, I'd like to check it out.I've heard changing models messes up caching and costs more. parent danilovilhena 3 months ago
I've heard changing models messes up caching and costs more.