Comment by blackcat201

Cool project, seems like your model have similar WER as mine (4th reference in readme). Do you plan to do any pre-training on the encoder part in the future? Maybe something like this[1]

[1] https://ai.facebook.com/blog/wav2vec-20-learning-the-structu...