Comment by graphene

There's deeplearningbook.org, which starts with the basic maths and then goes into considerable detail on cutting edge work.