Comment

Comment by davidlt

It's the same pre-training, they are just adding more (+ better) SFT, RL, etc. (post-training). Model internal knowledge cut-off is still the same.

It seems we are doing pre-training every 6 months, and post-training every 4-8 weeks now.

parent davidlt 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton