Comment by ACCount37

People in the industry know that tokenizers suck and there's room to do better. But actually doing it better? At scale? Now that's hard.