Comment

Comment by Leynos

The model was sharded into ~800MB pieces over devices with 4GB RAM. Typical device storage is 16-32GB NAND. Throughput was 0.39tps.

Compromise enough devices (think thousands of off-brand TVs), and you have plenty of redundancy.

parent Leynos 18 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton