- Intel Core i9-11900KF 3.5 GHz 8-Core Processor
- Corsair H150i PRO 47.3 CFM Liquid CPU Cooler
- MSI MPG Z590 GAMING EDGE WIFI ATX LGA1200 Motherboard
- G.Skill Ripjaws V 64 GB (4 x 16 GB) DDR4-3600 CL18 Memory
- Samsung 970 Evo Plus 1 TB M.2-2280 PCIe 3.0 X4 NVME Solid State Drive
- MSI GeForce RTX 3090 TI SUPRIM X 24G GeForce RTX 3090 Ti 24 GB Video Card
- Corsair Carbide Series 275R ATX Mid Tower Case
- Corsair RM1000x (2021) 1000 W 80+ Gold Certified Fully Modular ATX Power Supply
- Microsoft Windows 11 Pro
On this setup I've been able to run every model 13B and below with 0 issue. Even been able to fine-tune Llama 2 13B using my own data (emails, SMS, FB messages, WhatsApp, etc.) with pretty fun results!
- Corsair H150i PRO 47.3 CFM Liquid CPU Cooler
- MSI MPG Z590 GAMING EDGE WIFI ATX LGA1200 Motherboard
- G.Skill Ripjaws V 64 GB (4 x 16 GB) DDR4-3600 CL18 Memory
- Samsung 970 Evo Plus 1 TB M.2-2280 PCIe 3.0 X4 NVME Solid State Drive
- MSI GeForce RTX 3090 TI SUPRIM X 24G GeForce RTX 3090 Ti 24 GB Video Card
- Corsair Carbide Series 275R ATX Mid Tower Case
- Corsair RM1000x (2021) 1000 W 80+ Gold Certified Fully Modular ATX Power Supply
- Microsoft Windows 11 Pro
On this setup I've been able to run every model 13B and below with 0 issue. Even been able to fine-tune Llama 2 13B using my own data (emails, SMS, FB messages, WhatsApp, etc.) with pretty fun results!