Comment Comment by vova_hn2 I'm not arguing with the rest of your points, but...> Just fine tune the open source Kimi 2.6 with an open source Portuguese datasetI think that tokenizers of all popular models are heavily biased towards English or English and Mandarin.And I don't think that it is possibple to replace the tokenizer without full retraining. parent vova_hn2 5 months ago
> Just fine tune the open source Kimi 2.6 with an open source Portuguese dataset
I think that tokenizers of all popular models are heavily biased towards English or English and Mandarin.
And I don't think that it is possibple to replace the tokenizer without full retraining.