Comment Comment by electronsoup > It gets into loops quite often, and surprisingly often gets the edit tool call wrongI find that running better quantization, like Q8 tend to prevent this even though its a bit slower to run, it saves overall time with less churnUsing 3.6-27b is even slower again than 3.6-35b, but I find the accuracy really pays off parent electronsoup 4 months ago
I find that running better quantization, like Q8 tend to prevent this even though its a bit slower to run, it saves overall time with less churn
Using 3.6-27b is even slower again than 3.6-35b, but I find the accuracy really pays off