Comment by discobot2

its more of a competitive approach to improve compute utilisation at lower batch sizes