Comment by TGower

The easiest way would be to setup some cameras and start recording everything. Gemini could already sort that into events you could query. If you have privacy concerns, at the current pace of progress, local LLMs should be up to the task soon if they aren't already.