Comment by sunbum

Why are you not just using yt-dl to download the subtitles? Using yt-dl you can also fallback in case the subtitles don't exist and instead download the videos, convert them to mp3, and then run them through whisper[1] locally.

[1] - https://github.com/openai/whisper