Comment Comment by so_tired > Human reading/talking/listening equivalent of 200 pages of text per day for 80 years would be just 13GB of raw data or 3B tokensI am sympathetic to the "total life time input" argument.But humans get a hand crafted curriculum inputs, evolved over 1000s of iterations, in a near-optimal language encoding.Also, if unsupervised gets us in-dist, and DRL seems to be not-bad in search-out-of-dist.... then we are getting close ?Certainly a x100 scaling of current techniques can get a useful enough machine that makes many human tasks trac-able?(I am not getting into the Turing / AGI / skynet argument) parent so_tired 6 years ago
I am sympathetic to the "total life time input" argument.
But humans get a hand crafted curriculum inputs, evolved over 1000s of iterations, in a near-optimal language encoding.
Also, if unsupervised gets us in-dist, and DRL seems to be not-bad in search-out-of-dist.... then we are getting close ?
Certainly a x100 scaling of current techniques can get a useful enough machine that makes many human tasks trac-able?
(I am not getting into the Turing / AGI / skynet argument)