Comment Comment by fshr > 5060I think you're referring to a 5060Ti 16GB, yes?32k context is easily done there. 64k can work with a more aggressive quant, but you lose a bit of speed. parent fshr 1 month ago
I think you're referring to a 5060Ti 16GB, yes?
32k context is easily done there. 64k can work with a more aggressive quant, but you lose a bit of speed.