Roundhill T-Rex 2X Long DRAM Dly TrgtETF

Another major factor is strong structural growth in demand, and this one is clearly satisfied.

The most straightforward reason is Nvidia’s need to keep upgrading its “token factory” hardware to deliver higher token throughput. This drives extremely fast generational upgrades in both HBM bandwidth and HBM capacity (size), leading to exponential demand growth.

As concluded in the earlier AI semiconductor analysis, token throughput equals HBM size multiplied by HBM bandwidth, and this roughly doubles with each new generation. On average, HBM size per GPU is growing more than 40% every year.

This demand curve is rising so steeply that it is very difficult for the supply side to keep up. Even with 14% growth in wafer production and 9% improvement in memory density, the overall $Roundhill T-Rex 2X Long DRAM Dly TrgtETF(RAM.US)DRAM supply growth simply cannot match the pace of AI-driven HBM demand.

In the hardware architecture, the attention stage’s KV cache requires both extremely high bandwidth and very large memory capacity. This gives HBM a unique and irreplaceable position. Even if HBM prices rise three to five times, the extra token throughput gained by investing in more HBM is still far more cost-effective than spending the money anywhere else.

Other memory technologies, such as SRAM, HBF, CXL, and PIM, are currently unable to compete directly with HBM in the critical KV cache and attention workloads. There is no viable replacement in sight for at least the next five years, and possibly much longer.

@Bridge Buzz SG

All things go through cycles, and $Roundhill T-Rex 2X Long DRAM Dly TrgtETF(RAM.US)memory is especially cyclical. The main driver is the extremely long lead time for capacity expansion. You simply can’t ramp up production fast enough to avoid mismatches when demand suddenly drops.

There are a few ways to meaningfully reduce or even largely escape traditional boom-bust cycles.

1. Customization: products aren’t interchangeable. Capacity can’t be easily redirected to other customers, so buyers have to sign long-term contracts.

2. Structural exponential demand growth: demand itself grows very steeply and consistently outpaces supply.

3. Rapid generational upgrades: each new generation quickly makes the previous one obsolete.

Hitting even one of these can take some of the sting out of traditional cycles. Hitting two or three can remove most of it.

@Bridge Buzz SG