Comment by pgz

I made something similar for Japanese learning, but instead of merging subtitles, I analyze the Japanese subs with mecab, look up the words I likely don't know based on their JLPT level, and add them with reading and translation on the top right of the video.

I also plan to auto generate Anki cards with unknown words when I do the analysis pass.