Comment

Comment by dhammack

My hypothesis is that all RNNs (and in general complex dynamical systems) need to be reset periodically. If run for too long without resetting, they tend to get stuck in strange states, blow up, or cease activating. You can see this effect by running a generative RNN model for a long time - eventually the output is garbage.

Under this model the next obvious question is why it takes so long to reset the brain's state. Maybe it can be done faster.

parent dhammack 10 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton