Comment

Comment by yccheok

Hi,

I’m currently building a Q&A chatbot and facing challenges in addressing the following scenario:

When a user asks:

"What do you mean in your previous statement?"

How does your framework handle retrieving the correct small subset of "raw knowledge" and integrating it into the LLM for a relevant response?

Without relying on external frameworks, I’ve struggled with this issue - https://www.reddit.com/r/LocalLLaMA/comments/1gtzdid/d_optim...

I’d love to know how your framework solves this and whether it can streamline the process.

Thank you!

parent yccheok 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton