There's clearly a sweet spot in the amount of entropy/unpredictability that is "interesting". Otherwise observing white noise would be the most interesting thing imaginable.
I don't know the details, but probably you would want to seek unpredictability in a higher level representation of the observed state. White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or two of featurization if the features are trained/designed for real world observations.
I don't know the details, but probably you would want to seek unpredictability in a higher level representation of the observed state. White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or two of featurization if the features are trained/designed for real world observations.