Comment by blue_devil

I think it's because pointing into space gives your actions physical coordinates that organize them similarly as in memory. In fact, a popular mnemonic technique is to envision the stuff you need to remember "positioned" along a street route or another physical space you know very well (it's called the Method of Loci).