I used a similar (but not identical) multi-column drill-down navigation technique in my Unnamed Gopher Client[0].
However, instead of coding my own scroll gestures, I delegated to CSS Scroll Snap, which works beautifully, even in complicated scrolling scenarios, and scrolls natively.
However, instead of coding my own scroll gestures, I delegated to CSS Scroll Snap, which works beautifully, even in complicated scrolling scenarios, and scrolls natively.
You can see here how accurate scrolling is: https://i.imgur.com/m9MBo4N.mp4
The main issue is detecting when scrolls end, but that can be addressed with a bit of cleverness.
I highly recommend giving Scroll-snap a try if you can.
[0]: https://github.com/zenoamaro/unnamed-gopher-client