fzxu22

Joined 4 years ago

Karma

Submissions

Member since

Jan 22

Recent submissions

Please don't use the word "self-hosted" if it's not hosted on your hardware. This thing depends entirely on cloudflares services and "generosity".

Comment · 2 months ago

Want to use this thread to ask the wise folks on HN: I’ve been running auto mode but always run within a docker container with only the necessary workspace dir mounted in. Is that considered safe or actually not?

Comment · 2 months ago

I poop for like 30 seconds so not very useful

Comment · 4 months ago

Can't wait to use Claude Cinematic Universe!

Comment · 5 months ago

That’s why I only run coding agents in containers with limited access to host resources.

Comment · 6 months ago

Thanks for the comment! And yes, redaction based measures will always face the trade-off between privacy vs intellegence you get out of LLM. e.g. provider will inevitably know you're in some sorts of legal/tax issue even without any PII. And for some case the intellegence you want will depend on LLM knowing some detail (e.g. your AGI when doing tax preparation).

On the other hand Moxie's Confer is really interesting! On first glance I thought it's using homomorphic encryption but it turns out to be based on hardware isolation. TIL +1

Comment · 6 months ago

The proxy keeps 2-way mapping of identified PII and the redaction e.g. Jane Doe <-> <PERSON_1> so the process is reversable i.e. redactions from LLM response will be replaced back to the original, and it should feel transparent on user end. I'll add more detailed example in README to make it clear.

Comment · 6 months ago

Working on this: https://github.com/KevinXuxuxu/anon_proxy, a sort of anonymization proxy to use with LLM providers. It does model (OpenAI privacy filter) + regex PII detection, and replaces them back-and-forth for API requests and responses. With locally hosted detection model, no PII leaves your local environment. I find it very useful especially when you're working on sensitive documents (legal, tax, immigration etc.), hope you find it helpful as well :)

Comment · 9 months ago

https://site.fzxu.me

The index is a bit outdated, it’s mostly about me working on my homelab.

Comment · 1 year ago

+1 happy freshrss user here

Comment · 2 years ago

Getting cheaper and better planes is good. But this is not a correct way of solving traffic problems in US. We need high-speed railroad network, not one airplane per household.

Comment · 4 years ago

LOL that's actually very useful as I'm trying to find out how the thing works

Comment · 4 years ago

Probably true according to this post: https://slc.is/#Best%20Wordle%20Strategy%20%E2%80%94%20Explo...

Comment · 4 years ago

You ... are not wrong ;)

Comment · 4 years ago

Thanks for the reply! I really appreciate your feedback on this. I wasn't giving much thought about coding style and naming etc. when I worked on this, just wanted to get it running asap. I'll definitely take a better look at your suggestion (I'm not very familiar with perl) and see if I find any time to improve this thing. cheers.