Comment by Filligree

The 7B model just barely fits in a 3090, but I've yet to get useful output; it usually gets stuck in a repetition loop.

Spent some time playing with sampling parameters, to no effect. Has anyone else had a go?