Comment by dementrock

Actually TensorFuse does support RNN by porting a subset of scan to TensorFlow. I've been using it to port Lasagne to support TensorFlow: https://github.com/dementrock/Lasagne-tf. The examples/recurrent.py there actually works.

Good suggestion on Neon!