Comment by theguysudo

PI is best for any local model not just Qwen but you can use hermes as it offers more kind of productivity though hermes is not optimized right for local agents which will somewhat affect your work balance but with some tweaks like

1.Trim the Token Tax: Run hermes tools and turn off everthing unused 2.Enable KV Cache / Prefix Caching