Comment Comment by benhalllondon I played around a bit and found out dropping the tokenisers version to 0.11.6 worked`pip install tokenizers==0.11.6` first parent benhalllondon 4 years ago
`pip install tokenizers==0.11.6` first