Comment

Comment by K0balt

Analog computation probably. Theoretically, technology like thermal wells and others that harness physics to find the local minimum energy state allow inference with multiple orders of magnitude improvements in size, energy, and speed. Rough back of the napkin gives SD-card size 1t parameter models on about 2.5 watts using thermal wells (cryogenic cooling required, afaik), achieving density approximately similar to NAND flash per parameter.
parent K0balt 15 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton