itsTyrion
Joined 4 years ago
Karma
60
Submissions
130
Member since
Apr 7
Joined 4 years ago
a well made (as in, unsloth) smaller quant will help a good amount here, without a notable reduction in performance or increase in perplexity
and it does use that sarcasm permission at times (I still dislike the way it generally communicates)