Comment

Comment by ozgung

I’m pretty sure “benchmaxxing” as defined is a standard post-training procedure for ALL models.

One can argue though some models are post-trained heavily for specific benchmarks and less for other datasets. So they are weaker on out of distribution tasks.

parent ozgung 4 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton