Comment by zippothrowaway

You're probably going to have to wait a couple of days for 4 bit quantized versions to pop up. It's 20B parameters.