Comment by Detrytus

The problem is: if you do that, then you need to create a big government agency that will interview the potential candidates, evaluating their value on the job market, in order to grant them a visa. Right now that job is done by their sponsoring employer, but if you give people ability to change jobs freely then employers lose any incentive to do so.