Comment

Comment by speedstyle

or Tinfoil [0]? They serve open models with container integrity attested by Nvidia/AMD enclaves. Every cloud provider offers this of course, but not usually in a way that can be shared between distrusting users for economical inference. It still relies on the open-source containers being secure, and there's probably hardware sidechannels and stuff, but personally (ie privacy not liability) I trust it more than a contract

[0] https://tinfoil.sh

parent speedstyle 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton