Comment Comment by teaearlgraycold Aren’t there only 2^16 tokens? Seems easy to test for all of them, but I might just not understand the tokenizer. parent teaearlgraycold 2 years ago
