Comment by alex43578

Enterprise GPUs have a lot longer effective life than these consumer chips (although even the old 3090s are reasonably useful, especially with the recent driver unlock tech). I'd argue that these consumer chips have only now gotten to the memory capacity/processing capacity to make local LLM use actually reasonable.