Comment by kinibha

Can response be cached at llm side?

If yes then with each question. You can pass random number and check it really understands