johngriffin

This is an example of an insurance claim that was denied by AI. The insurance company was ordered to explain the AI decision making process, which they were unable to. Specifically they were unable to provide the llm settings such as temperature, the specific prompt used etc.

Legal AI tools are generally not used for decision making but for improving productivity of legal professionals, for example by helping to review large amounts of contracts. Ultimately lawyers have to review the work and take responsibility for it's correctness. We actually aim to reduce error rates overall. In the case of CompleteFlow, our agentic platform for contract and document processing, we also provide access to all those settings that were demanded by the judge in this case since we do single tenent private cloud hosting and customers can select the models and settings they want to use for a cost / performance trade-off.

Nice! Interesting to see LlamaParse topping the leaderboard. We've been evaluating LiteParse for document parsing in Completeflow.ai

Good overview, when can we expect part 2?

Love the app, not sure why wechat shows up as the first post type for me. The summary one would probably make the most sense as it allows me to know that I've been understood in the most concise form.