Comment by foundzen

I taught my parents how to use LLM chat apps. I was pleasantly surprised to see them use it all the time. And even more shocked to see them pasting entire whatsap messages containing passwords, upload income tax files, and a lot more private details with LLMs. They rarely pause to think about privacy/security before sharing info with LLM services. So I'm working on an interface that works as a privacy filter, making sure the private info does not leave the device. It redacts /anonymizes/obfuscates private information from what we share with LLMs via on-device model, and plugs back the output with the private info to make it appear almost similar to the output as before.