What's the best way to structure data from a video?

Is there software to "parse" video content and get information about what happened in the frame and at what time?

Imagine there's security camera footage and instead of watching the whole video, software could process it to say that a person entered a frame at a given time or a dog walked by.

Is there a commercial product or open source option for accomplishing this scenario? Possibly using ML?