Comment by WJW

That's still mismanaging your work and time, but indirectly. Find a better job where your colleagues respect your personal time.