Comment by my_username_is_

Check out the Epic Kitchens project, there are labeled video data sets of cooking, doing dishes, etc.

https://github.com/epic-kitchens