redohmy

Toronto-based Taalas just emerged from stealth with a claim that’s shaking the hardware world: 17,000 tokens per second on Llama 3.1 8B.

How? By physically etching the AI model directly into the silicon transistors. No HBM. No liquid cooling. Just raw, hardwired performance that is 10x faster and 20x cheaper than traditional GPU inference.

An interesting direction, beyond optimizing the KV cache for long-context inference, is to rethink where inference actually runs. If LLMs can be optimized to be efficiently deployed at the edge — for example on AI PCs — the burden on centralized data centers could be significantly reduced. In that case, inference demand may shift away from hyperscale compute clusters, easing both capacity and power pressures.

TrendForce’s latest forecast signals a structural price shock across the memory and storage stack. Contract pricing for PC DRAM is projected to exceed 100% QoQ, while conventional DRAM, server DRAM, NAND, and enterprise SSDs are all seeing double-digit to near-triple-digit increases. The key driver is not traditional PC demand—it is the capacity reallocation toward HBM4 and AI infrastructure, which is tightening supply for mainstream memory.

For IT procurement teams, this marks a shift from cyclical pricing to allocation-driven pricing, where long-term supply agreements and OEM demand dictate availability. For organizations holding surplus DDR4/DDR5, server memory, or enterprise SSDs, the current environment represents a rare asset-recovery window as secondary market values track rising contract prices.

"Chinese chipmaker CXMT is offering 32GB DDR4 modules for approximately $138 domestically, while global prices surge to $300–$400 in early 2026, this represents a structural, long-term shift towards a bifurcated memory market."

The IT world is facing a fundamental change in how hardware is being prioritized. Recent reports confirm that NVIDIA has canceled the mid-cycle RTX 50-series "Super" refresh and pushed the next-generation RTX 60 "Rubin" architecture to 2028.

Why is this happening? The primary driver is "RAMageddon"—a global shortage of GDDR7 and high-bandwidth memory. With data center AI revenue now making up nearly 90% of NVIDIA's earnings, the limited memory supply is being diverted to enterprise AI chips. Simply put: the margins on AI accelerators are too high for manufacturers to prioritize consumer-grade graphics cards.

What is the impact?

Price Volatility: We are seeing an RTX 5090 price spike of 75% or more in retail, with some flagship models hitting $5,000.

Negative Depreciation: For the first time, used high-end cards like the RTX 4090 are selling for more today than they did at launch three years ago.

Extended Lifecycles: Organizations that planned for a 2026 refresh must now maintain their current fleets for another two years.

For IT leaders, the strategy has shifted from "upgrading" to "asset management." The hardware on your desks today has become a high-value commodity in a supply-constrained market.

Why is a standard business laptop or a mid-range smartphone more expensive in 2026?

The answer is not inflation. It is wafers.

In today’s semiconductor market, every DDR5 module, HBM stack, LPDDR chip, and enterprise SSD starts from the same 300mm silicon wafer. When manufacturers allocate those wafers to AI-grade memory for data centers, they are no longer available for PCs, smartphones, or consumer devices.

This article breaks down the full memory hierarchy—DDR4, DDR5, LPDDR, GDDR, HBM, and NAND—and explains the “Silicon Zero-Sum Game” driving record price increases across the entire IT ecosystem.

If you manage hardware budgets, data centers, or surplus IT assets, this is essential reading for understanding the 2026 memory super-cycle.