Comment by dhimes

On average it's a requirement of the conservation of momentum. But note that sometimes photons come out in a different direction (scattered), including to opposite direction (reflection). In these cases the momentum is absorbed by the medium.