Comment by senderista

You can mitigate this imbalance (at the expense of more cache misses) in the usual way by applying the power of 2 choices:

https://lph.ece.utexas.edu/users/krimer/pub/im11_bf.pdf