Show HN: LitigationBench. A Litigation Task-Based AI Benchmark

Adding to the sea of AI benchmarks, but with a focus on legal and litigation-based tasks and tests. E.g., hallucinating cases, misreading precedent, drafting, AI writing tics, etc.

Developed as part of a litigation platform I've started, but not sharing this benchmark to promote that. Just thought the findings were interesting--namely, Anthropic's models (except for Haiku) producing zero hallucinated cases.

Also, if anyone would like to see additional tests / benchmarks or models tested, let me know and I'll incorporate them into v3 if it makes sense.

2 points ybathaee 3 months ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton