Comment by tosh

This is basically a GPT-4 level model that runs (quantized) on a 32gb ram laptop.

Yes it doesn't recall facts from training material as well but with tool use (e.g. wikipedia lookup) that's not a problem and even preferable to a larger model.