I have an old dell latitude 3420 with 16 gig of ram. It's running Pop!_OS. I used Alpaca to load the Mistral(7b) model. I ask it questions and it answers. Didn't cost anything.
On a different computer running Cinnamon Mint I used GPT4ALL to load a Llama 3 8b model. I use it to read a bunch of local docs for me. It also didn't cost anything.
On a different computer running Cinnamon Mint I used GPT4ALL to load a Llama 3 8b model. I use it to read a bunch of local docs for me. It also didn't cost anything.