Comment by TylerLives

You could do it by hand, by calculating the gradients and doing backprop with pen and paper.