Not every request is meant to be served below 500ms and this is server which supposed to be called couple of times a minute not milliseconds
We started with caching but this created a new kind of problems of its own (veterans know what circus of man eating from outside out clowns this create) but client was mad manual refresh is causing "freezes" in the system.
So we ban LLM and problem solved until client starts asking why ChatGPT, Claude, whatever he prefer can't access data and release him/her from pain of using brain
We started with caching but this created a new kind of problems of its own (veterans know what circus of man eating from outside out clowns this create) but client was mad manual refresh is causing "freezes" in the system.
So we ban LLM and problem solved until client starts asking why ChatGPT, Claude, whatever he prefer can't access data and release him/her from pain of using brain