Comment by cloakandswagger

> correlated to the tokens that you have access too (and everyone else does)

Do you mean "the weight parameters you have access to[sic]" or do you frequently find yourself limited by the model's token vocabulary?