Comment Comment by amarshall What context length and kv cache quant (if any) are you using? And MTP? parent amarshall 4 months ago
