This is a major plot point of the book A Beautifully Foolish Endeavor, sequel to An Absolutely Remarkable Thing. The main antagonist uses high quality VR to trick the brain into full reality from someone else's perspective. The effect on society is grim, and when society is being actively graded by aliens on its worth, this is a big problem.
Highly recommend both books.