Comment by phil-martin

In addition to that from a LLM-as-a-service vendors point of view, for short prompts that 1000's of people are asking for each day, if it is cheaper to serve a response that is randomly selected from 1000 cached versions than to regenerate each time, particularly if it is for SVG pelicans, it would make sense to do it that way.