Comment by sushirain

You can use a character RNN that reads the fragmented input char by char, and feed its output to your NN.