Comment by KaranSohi

I've used qwen but not in the way you mentioned. How big is the qwen model you run, 8B? would also love to know the context window you use, as sometimes the models go out of context...

Thanks for replying this was really insightful :)