--- type: "Topics" locale: "zh-CN" url: "https://longbridge.com/zh-CN/topics/39599005.md" description: "Memory plays the role of the "operating desk" in AI, and it's the bottleneck link.The core bottleneck in AI training and inference is not insufficient computing power, but rather the speed at which data is fed to the GPU is not fast enough. The GPU calculates extremely fast, but the memory bandwidth can't keep up, causing the GPU to idle and wait for data. This is why HBM (High Bandwidth Memory) has become the most in-demand component—it is stacked directly on the GPU chip, with bandwidth more than ten times higher than ordinary DDR5.An H100 has 80GB of HBM with a bandwidth of 3.35TB/s. This specification is simply unattainable for ordinary DRAM; only Samsung, SK Hynix, and Micron can produce it, and production capacity is extremely limited.Simply put: SSD determines how much data you can store, memory determines how fast the AI can run. The latter directly bottlenecks the ceiling of AI performance." datetime: "2026-03-29T00:03:15.000Z" locales: - [en](https://longbridge.com/en/topics/39599005.md) - [zh-CN](https://longbridge.com/zh-CN/topics/39599005.md) - [zh-HK](https://longbridge.com/zh-HK/topics/39599005.md) author: "[彼得.林奇的交易员Jeff](https://longbridge.com/zh-CN/profiles/17107631.md)" --- > 支持的语言: [English](https://longbridge.com/en/topics/39599005.md) | [繁體中文](https://longbridge.com/zh-HK/topics/39599005.md) # Memory plays the role of the "operating desk&#… ### 相关股票 - [Samsung Electronics (SSNGY.US)](https://longbridge.com/zh-CN/quote/SSNGY.US.md) - [XL2CSOPHYNIX (07709.HK)](https://longbridge.com/zh-CN/quote/07709.HK.md) - [Micron Tech (MU.US)](https://longbridge.com/zh-CN/quote/MU.US.md) - [Hudbay Minerals (HBM.US)](https://longbridge.com/zh-CN/quote/HBM.US.md) - [Simpson MFG (SSD.US)](https://longbridge.com/zh-CN/quote/SSD.US.md)