lukebechtel
Joined 11 years ago
Joined 11 years ago
> As an early proof of concept, Kimi K3 designed a chip to serve a nano model built on its own architecture. In a single 48-hour autonomous run, K3 built, optimized, and verified the chip using open-source EDA tools on the Nangate 45nm library. Within 4 mm², the chip closes timing at 100 MHz and sustains over 8,700 tokens/s decode throughput in simulation, packing 1.46M standard cells, 0.277 MB of SRAM, and an INT4 MAC array with fused dequantization. A chip built by a model, for a model, reflects K3's long-horizon agentic capabilities.
Absolutely wild.
Those who work on agent harnesses for a living realize how sensitive models can be to even minor changes in the prompt.
I would not suspect quantization before I would suspect harness changes.
Say hi : luke (at) lukebechtel.com
Current: - Founding Engineer @ Infinity AI Institute - AI/ML Consulting @ Positive Sum Products (https://positivesumproducts.com)
Former: - Founder @ Reasonote (https://reasonote.com) - Principal AI/ML Eng. @ Regscale (https://regscale.com) - Dir. of Eng. @ Revaly (now Cadchat) (Acq. in 2023) - Cofounder @ Collider Inc. (Acq. in 2022)