Comment by matthewfcarlson

I’m actually working on a small project that’s exactly this! Less quant so it’s only 150M parameters but this is amazing.