Comment by hirako2000

You've got to understand, proprietary models operate as the following:

- release: full precision, debrided, uncapped context

- shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread.

- down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing.

Rince and repeat.