Depends on the actual audience, I guess. My stated “wisdom” comes in part from
/r/LocalLLaMa, and my impression is that the tasks that users there give their models to try them out lean towards rather simplistic, on the reasoning side.
But there I literally did read “you don’t need anything better than 4 bpw” a bunch of times.
But there I literally did read “you don’t need anything better than 4 bpw” a bunch of times.