I wish more people experimented with hand input since this has essentially been solved in recent years due to advancements in computer vision: https://mediapipe.dev/. Yeah it might be awkward to ask the user to activate their camera, etc etc. But right now I'm barely seeing any experimentation in this direction which is a shame.
Part of me wonders if it's just that people don't know that this is solved on the web, so make sure to go here and try it out and make something if Brets article appealed to you: https://google.github.io/mediapipe/solutions/hands#javascrip... + https://codepen.io/mediapipe/pen/RwGWYJw