Comment Comment by s-macke Here is the list of the 100k GPT-4 tokens as text file.https://gist.github.com/s-macke/ae83f6afb89794350f8d9a1ad8a0...Yes, a lot of tokens are just for code.Edit: Here as raw link for the poor mobile devices:https://gist.githubusercontent.com/s-macke/ae83f6afb89794350... parent s-macke 3 years ago
https://gist.github.com/s-macke/ae83f6afb89794350f8d9a1ad8a0...
Yes, a lot of tokens are just for code.
Edit: Here as raw link for the poor mobile devices:
https://gist.githubusercontent.com/s-macke/ae83f6afb89794350...