wr
hn
Top
New
Best
Ask
Show
Jobs
Back
e
eiln
Joined 11 months ago
Karma
83
Submissions
4
Member since
Nov 28
View on Hacker News
Recent submissions
Getting 50 GB/S Back from the Apple Neural Engine
e
eiln.github.io
218
eiln
1 month ago
36
comments
Comment · 1 month ago
RTL performance erratum in the Apple M3 Neural Engine throttles DRAM weight streaming throughput down to 17–19 GB/s from the nominal 45–60 GB/s. Avoiding the problematic path in the kernel DMA engine's speculative prefetch ring increased Llama 3.2 1B token throughput from 10.0 to 24.3 tokens/s.
Getting 50 GB/S Back Out of the Neural Engine
e
eiln.github.io
3
eiln
1 month ago
1
comments