Is it the look of hand drawn you're after or is that you feel it will be easier to just draw with your hand? If it's the former you could use something like inkscape to draw the diagrams as SVGs and then use rough.js [1] to render them in a hand drawn way.
[1] https://roughjs.com/