Discussion

Ask HN: Have you reduced costs by caching LLM responses?

Providing a chat bot to a large user base means you spend a lot of money on similar requests. I'm looking for best practices or lessons learned from implementing LLM-enabled apps at scale. Thanks in advance.
2 points KennyFromIT 3 years ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton