Comment

Comment by szmerdi

I like the initiative and the large scale collaboration but in terms of quality, my observation on one of the newly added languages (an underrepresented one) is it outputs dramatically grammatically gibberish! As though it hasn't been through the SFT/RLHF step at all.

(P.S. I'm a native speaker of this language. I tested Aya on reasoning, creativity, and summarization with two examples per task)

parent szmerdi 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton