Comment by kilnr

I get about the same speed (35 tok/s) out of 13B Llama2 on a 4070 Ti, FWIW.