inaciom
Joined 3 years ago
Karma
56
Submissions
10
Member since
Sep 25
Recent submissions
Comment · 2 years ago
Here's also the Github: https://github.com/try-reason/reason
Comment · 2 years ago
Awesome! That'd actually be great — just a warning that the repo is a complete mess right now.
If you need any help, feel free to contact me either on Github or in my email ([email protected]).
Comment · 2 years ago
Great question!
The return value is not guaranteed to be correct. REASON uses function calling to force the model to return a valid JSON object; however, sometimes models hallucinate.
For OpenAI models that have JSON mode, REASON uses that instead.
However, it has an internal validation step where it checks the return value, and if it's not correct, it'll throw an error (this behavior can be disabled though).
Here's more info about it: https://docs.tryreason.dev/docs/essentials/reason#will-the-l...
Your suggestion to use logits is super interesting, though! And it sparked this line of thinking: since REASON uses function calling, it has been somewhat difficult to integrate with OSS models — however, if under-the-hood we use Jsonformer, that might be the missing key for incredible OSS model support (?). What do you think?
Comment · 2 years ago
That's weird. Can you access using this URL https://tryreason-www.vercel.app/ ?
EDIT: if that also doesn't work, there is the documentation — which is where 99% of the info is: https://docs.tryreason.dev/
Comment · 2 years ago
To me https://tryreason.dev is working. Which browser are you on?
Comment · 2 years ago
Thanks for the feedback! :)
Yeah, adding audio to the video would help — I'll try do record something later today and update it.
When building LLM apps a good chunk of the workflow is testing new stuff and seeing what works or not, and one of the most useful features of RΞASON to me is that its OpenTEL compatible. Which allows for things for you to inspect your LLM at a close level with ease (see: https://docs.tryreason.dev/docs/essentials/observability#usi...).
Comment · 2 years ago
The website has a video demo in case you guys want to check it out: https://tryreason.dev