Buy any laptop with following specs -
1. 32GB RAM (stock) + Extra slot with >= 32GB support (higher freq. = better perf.)
2. SSD 1TB
3. AMD Ryzen CPU (6x2 or 8x2 threads)
4. Nvidia RTX series GPU with atleast 8GB VRAM (not sure if 12GB VRAM comes with any laptop).
Quantized LLMs upto 8b parameters can be easily run on above specs. Quantized models are getting better and better. I use them for code suggestion and code gen.
Quantized LLMs upto 8b parameters can be easily run on above specs. Quantized models are getting better and better. I use them for code suggestion and code gen.