I have a 3090 founders edition sitting on a shelf. The FE cards had VRM cooling issues, IIRC. Would this unlock have any uplift even if I undervolt and don't increase the power draw limits much? The use-case I'm thinking is to run a model to power a local only voice assistant for my family. I'm not really familiar with what instructions are used most heavily by LLMs, but is my read correct that this would be expected to help with TTFT? I'm curious if there's anything about this that helps in particular with audio processing models.
And maybe I'm overthinking the cooling issue. It's not like I'm hammering it 24/7. Probably fine to burst high on power draw on use.
Btw, I always love moments like this where library or project owners stumble on their work and chime in on the comments. I really appreciate your work here. It's given me motivation to actually do something with parts that have been sitting on a shelf.
And maybe I'm overthinking the cooling issue. It's not like I'm hammering it 24/7. Probably fine to burst high on power draw on use.
Btw, I always love moments like this where library or project owners stumble on their work and chime in on the comments. I really appreciate your work here. It's given me motivation to actually do something with parts that have been sitting on a shelf.