This is a demonstration of the abilities of OpenAI's CLIP neural network. The tool will download a YouTube video, extract frames at regular intervals and precompute the feature vectors of each frame using CLIP.
You can then use natural language search queries to find a particular frame of the video. The results are really amazing in my opinion...
You can then use natural language search queries to find a particular frame of the video. The results are really amazing in my opinion...
If you want to experiment with it yourself, I prepared a Colab notebook that can easily be run: https://colab.research.google.com/github/haltakov/natural-la...