I saw it yesterday too. I'm interested in attention models, but I'm not a skilled enough practitioner to say anything meaningful about them yet.
Someone linked me the author's more recent article [1] yesterday which claims hierarchical attention models totally outclass traditional RNNs/LSTMs. I really want to read an empirical comparison or a HN thread with experts chiming in.
Someone linked me the author's more recent article [1] yesterday which claims hierarchical attention models totally outclass traditional RNNs/LSTMs. I really want to read an empirical comparison or a HN thread with experts chiming in.
[1] https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c7...