tygra
Joined 2 years ago
Joined 2 years ago
Give qwen3:30b and gpt-oss:20b a try. You don't need a fancy GPU, just a modern CPU. Those models are already pretty solid for analyzing your personal data.
You can buy a good laptop and run open-source LLMs locally. 100% private. Disable its network. Stay offline.
Time to stop feeding the machine!
YOU CAN!
;)
Of course, you need decent hardware to run LLMs locally, but you don’t need a super high-end computer to host qwen3:30b or gpt-oss:20b. You don’t even need a GPU for those models, as long as you’ve got a modern CPU. And they’re already pretty solid for writing and coding.
Sam Altman actually said this on a podcast with Theo Von recently.
“So if you go talk to ChatGPT about your most sensitive stuff and then there’s like a lawsuit or whatever, we could be required to produce that,” Sam told Theo.
He even asked Theo about his own ChatGPT usage, and Theo admitted he doesn’t use it much because of privacy concerns.
Sam’s response:
“I think it makes sense... to really want the privacy clarity before you use [ChatGPT] a lot — like the legal clarity.”
:O
For work, as an employee, sure, it's easy to say the company approved ChatGPT or Gemini, so you can go ahead and upload, for example, usage data to get a retention analysis. But what if you're the employer?
"All these sites may as well have all my information." I don't think so. That's scary!
But you do have a choice.
If you want to upload your bank statements and ask an AI, "How did my spending habits change in Q2 compared to Q1?" or upload your blood test results and ask, “Give me specific nutrition, lifestyle, and supplementation recommendations," you can run LLMs locally. No data will leave your computer.
Personal: So, you download and run open-source LLMs on your computer?
But I'm not sure that in 3-5 years people will just give their sensitive financial, medical, or legal data to cloud AI providers without a second thought.
If you can run an open-source LLM locally on your own computer, completely offline, and use it for legal, finance, or medical topics, would you still say no to that?
Just last week I wanted to do some financial analysis with ChatGPT (GPT-5), but I wasn't comfortable uploading the CSV with all my transaction data. Instead, I used Qwen3 running locally on my MacBook to anonymize the data first, and then uploaded the sanitized version to ChatGPT.
¯\_(ツ)_/¯
I run Qwen3 locally for coding and writing. It’s a solid model.
Framework Desktop is becoming really popular. The one with the Max+ 395 and 128GB of RAM is an absolute beast. I might buy a Beelink GTR9 Pro (Max+ 395 with 128GB RAM), which costs around $2,000.
llama.cpp is the real deal. I’m using it as the engine for the product I’m building right now (https://tygra.ai/).