Comment by viraptor

That looks like a classic Actor/Critic setup, yet it's not mentioned even once in the paper. Am I missing some large difference here?