Comment by cruffle_duffle

Why not replace the backend of your site with the LLM? Let it do the recommendations in structured inputs and outputs so the front end isn’t a chat interface but leverages the fuzzy nature of LLM’s.