This project is just funky OCR, i.e. "offline" handwriting recognition that operates on the pixels of the final image only. That means it works on scans, but can't take stroke order information into account.
What you're talking about would be "online" handwriting recognition, where timing information about each stroke is available.
What you're talking about would be "online" handwriting recognition, where timing information about each stroke is available.