Comment by ForceBru

This is crazy to me as well: half a terabyte (!) of RAM?! How is that even possible lol (I know this is possible, but seems totally overkill, even though I know LLMs eat RAM for breakfast)