While an interesting use of applied RL, in some sense isn't this just another way to cast the compression/compute tradeoff? I.e. can't we just achieve the same effects by using another compression scheme which trades off local compute for better compression?
Running MuZero online sounds like a fairly computationally expensive prospect...
Running MuZero online sounds like a fairly computationally expensive prospect...