Comment Comment by atgctg Tiktoken added support for GPT-4o: https://github.com/openai/tiktoken/commit/9d01e5670ff50eb74c...It has an increased vocab size of 200k. parent atgctg 2 years ago
It has an increased vocab size of 200k.