houslast

Pushing the Limits of AMD Zen 3: Achieving 85.3 GFLOPS on a Single Core! I recently took on the challenge of squeezing every drop of performance out of a single AMD Zen 3 core, successfully reaching a blazing-fast 85.3 GFLOPS in FP32 matrix multiplication. By diving deep into low-level software optimization—focusing on advanced SIMD vectorization, strict cache management, and instruction pipelining—I managed to maximize CPU efficiency without relying on multi-threading. This project serves as a powerful proof of concept for high-performance computing (HPC) enthusiasts, proving that deeply optimized code can still unlock incredible hidden potential in modern silicon.

TL;DR: By instantiating a CUTLASS s16816gemm_f16 kernel with S=3 pipeline stages, 256×128 threadblock tiles, and epilogue vectorization width 4, I achieved 31.9 TFLOPS FP16→FP32 on an RTX 4060 (AD107) at N=8192 — 14.3% faster than the same GPU's cuBLAS baseline of 27.9 TFLOPS, and 52.7% of the 60.55 TFLOPS theoretical tensor-core peak.