Recent submissions

Comment · 2 years ago
Evaluation dataset designed to test the capabilities of Retrieval-Augmented Generation (RAG) systems. Paper with details and experiments is available on arXiv: https://arxiv.org/abs/2409.12941.

Dataset Overview 824 challenging multi-hop questions requiring information from 2-15 Wikipedia articles Questions span diverse topics including history, sports, science, animals, health, etc. Each question is labeled with reasoning types: numerical, tabular, multiple constraints, temporal, and post-processing Gold answers and relevant Wikipedia articles provided for each question

Key Features Tests end-to-end RAG capabilities in a unified framework Requires integration of information from multiple sources Incorporates complex reasoning and temporal disambiguation Designed to be challenging for state-of-the-art language models

Usage This dataset can be used to:

Evaluate RAG system performance Benchmark language model factuality and reasoning Develop and test multi-hop retrieval strategies

Comment · 6 years ago
“Facebook users, randomized to deactivate their accounts for 4 weeks in exchange for $102, freed up an average of 60 minutes a day, spent more time socializing offline, became less politically polarized, and reported improved subjective well-being”

In my experience Facebook offers polarization and information overload on one side, or a barrage of memes and random nostalgia on the other. I’ve given up on trying to manage what is recommended to me there, although for a while I did purge my friends and likes carefully, to some effect.

I don’t go so as far as deleting Facebook but it’s definitely less a resource and more an entertainment / distraction vehicle

Comment · 6 years ago

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton