Comment by oggreen

How is prompt caching different than caching responses in a database? If you use the same prompt wouldn't you want the same answer? Or can this be used for some type of intermediate process where different questions may utilize the same prompt in some type of workflow?