Comment by drittich

Things like the number of GPU layers, whether to use flash attention or not, enabling MTP, playing with context size.