chanchar
Joined 10 years ago
Karma
10
Submissions
15
Member since
Jul 6
Joined 10 years ago
> Nothing stops you building another layer of endpoints to service your frontend.
They could've added a new endpoint for that specific usecase but I'm assuming they've simplified their actual needs to this one example.
Love the idea of adding CoT as a field in the expected structured output as it also makes it easier from a UX perspective to show/hide internal vs external outputs.
> Structuring your inputs with XML is very good. Even if you're trying to get JSON output, XML input seems to work better. (Haven't extensively tested this because eval is hard).
Would be neat to see LLM-specific adapters that can be used to swap out different formats within the prompt.