Comment by nico

Will that make the model run/feel faster?

I can run models with 30-40b parameters on my computer, but they feel a lot slower than the 1-7b ones

So would this make the 30-40b parameter modes run faster? Or at least “feel” faster?