Comment by racoonear

http://neuralnetworksanddeeplearning.com/ is also a decent introduction about neural network. Doesn't cover recurrent neural network though.