Comment

Comment by bartdegoede

It’s gets much larger (there’s the potion-multilingual-128M model, distilled from bge-m3 which has like 100 languages), so it gets to ~120m range for the lookup table (4x smaller if you’d do int8 quantization, so you could get to to 30-35mb).
parent bartdegoede 3 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton