snippyhollow

Joined 17 years ago

Karma
1,502
Submissions
209
Member since
Feb 25
Research scientist at Facebook AI Research.

http://github.com/syhw

View on Hacker News

Recent submissions

Comment · 3 years ago
We changed RoPE's theta from 10k to 1m and fine-tuned with 16k tokens long sequences.
Comment · 6 years ago
Thanks for the feedback, we'll fix this.
Comment · 6 years ago
Comment · 7 years ago
It is like `cp`.
Comment · 8 years ago
Comment · 9 years ago
Comment · 9 years ago
Comment · 9 years ago
Comment · 9 years ago
Comment · 9 years ago

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton