Comment

Comment by Sajarin

They have a bit more info on their announcement blog post[0]

> Belfort today released the "so far" CIFAR demo, an encrypted implementation of ResNet-20, a popular model for image classification. It outperforms recent SOTA by 3x with a total latency of less than 200ms

Not many details on how they've done this, so I'm a bit skeptical. Fast HE is a holy grail.

> Belfort's image classification is built on top of its upcoming GPU library, Cyclops. It comes with several optimizations that make Cyclops extremely fast on Encrypted AI workloads.

Looks like a lead up to an upcoming library release

[0] https://belfortlabs.com/blog/sofar

parent Sajarin 3 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton