slushy-chivalry
Joined 7 years ago
Joined 7 years ago
Sure, for certain tasks. For other tasks retrieval is less useful.
I think "cleverness" is a function of your (and your team's) experience in a particular language / domain space
I worked with teams where verbose Java is considered "simple, straightforward, and easy to understand"
I also worked with teams where terse Haskell is considered "simple, straightforward, and easy to understand"
and of course these codebases look nothing alike
I remember reading the original paper a while ago but always forget (pun intended) where to connect stuff
then I realized that memorizing it visually is not the best approach, it's better to think about it in this sorta loose fashion -- I remember there is forget gate, well it forgets previous stuff so there is probably some hadamard product somewhere, it probably needs some inputs and previous hidden states...there was some -1,1 forcing in candidate memory so probably needs tanh instead of sigmoid...and then piece by piece i can reconstruct it pretty closely
the answer to RNN is non-trivial, but perhaps Recurrent in RNN might be of some use
Now if only the education system improved as well and stopped feeding the kids useless information.