Hot Chips 2026: Samsung makes LPDDR5X smart with logic unit in memory — LPDDR5X-PIM is 3.01x faster than LPDDR5X in AI inference with 8x the bandwidth

Nvidia introduced NVHBM, a custom high-bandwidth memory technology with 30% more bandwidth than HBM4E. The design moves the memory controller to the base die, improving performance and power efficiency. Nvidia plans to collaborate with suppliers like Samsung and SK Hynix for manufacturing. The industry expects growing demand for custom HBM solutions.

NVIDIA unveiled NVHBM, a custom HBM base die technology, aiming to lead the custom high-bandwidth memory market. Developed with major memory suppliers and Annapurna Labs, NVHBM integrates the memory controller into the HBM base die, potentially increasing memory bandwidth by 30%, reducing power consumption by 15%, and freeing up 25% more GPU area. NVIDIA aims to shift base die design from memory makers to xPU companies like itself.

Nvidia introduced NVHBM, a custom high-bandwidth memory for AI accelerators, promising 30% higher bandwidth and 15% lower power than HBM4e. It's available to NVLink Fusion partners, with Amazon's Annapurna Labs as the first adopter. The technology aims to improve performance and efficiency for AI workloads, though benefits won't appear in current systems.

South Korea July 2026 semiconductor export data showed memory chip shipments up 276.9% year over year, while system semiconductor exports fell 0.7%, according to the Ministry of Trade, Industry and Energy. The article links the divergence to AI inference needing higher memory bandwidth. It cites Q2 2026 profits for Samsung and SK Hynix and notes a pending US DRAM supply-restriction class action.

Bandwidth reported Q2 revenue of $219.9M, up 22.2% year over year and slightly above estimates, with adjusted EPS of $0.37 and adjusted EBITDA of $27.77M. It raised full-year revenue guidance to $905M midpoint but lowered adjusted EPS to $1.75. Management cited AI-enabled voice and messaging demand; guidance and margin stability drove a negative market reaction.

Strategic Performance Drivers AI is fundamentally shifting enterprise buying decisions toward providers capable of supporting mission-critical, compliant, and high-performance voice interactions. The company secured five new million-dollar-plus customer wins and expansions in Q2, all of which included Maestro or AI services, signaling strong product-market fit.