Comment by denali53

Agree - great intro! Could someone with much more knowledge point more to BitNet and other 1-bit models... seems like developments here could lead to a step change in small/local models? What is the theoretical limit to the power of such models?