Comment by cbo100

I get the right answer on the 8B model too.

It could be the quantized version failing?