<div id="readability-page-1"><div>         <div>                        <p>,  /PRNewswire/ -- The rapid expansion of artificial intelligence (AI) workloads is forcing a fundamental redesign of data center infrastructure, driving historic memory shortages and opening a rare market window for alternative memory technologies, according to Chuck Sobey, founder of ChannelScience and general chair of the Chiplet Summit.</p>             <p><span>                 Continue Reading                   <br/>                   <i></i>                                </span>             </p>             <div>               <div>                 <div>                                       <div>                                                               <figure>                        <p><img id="imageid_2" src="https://imageproxy.pbkrs.com/https://www.prnewswire.com/news-releases/null?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" original-src="https://imageproxy.pbkrs.com/https://www.prnewswire.com/news-releases/null"/>                    </p>                       <figcaption>         Credit: Digitimes       </figcaption>     </figure>                                                                                  </div>                 </div>               </div>             </div>             <p>Speaking on the industry's shift, Sobey highlighted that AI workloads differ structurally from traditional enterprise tasks. While legacy workloads stress the CPU, network, and storage—often leaving processors waiting for I/O—modern AI tasks, such as deep learning training, large language model (LLM) inference, and retrieval-augmented generation (RAG), are critically bound by memory bandwidth.</p>                            <p><b>The bandwidth gap and power crisis</b></p>               <p>The demands of the AI era are unprecedented. Sobey noted that AI systems can require up to 10 terabytes per second (TB/s) of GPU memory access—roughly 50 to 200 times the bandwidth of standard DDR5. Unlike web and cloud requests that deal in kilobytes, AI accesses involve gigabyte-sized tensors, necessitating algorithms that exercise the entire memory storage hierarchy.</p><p>This architectural strain has profound economic consequences. Sobey described the modern AI data center as a &#34;<span>token</span> factory,&#34; where revenue is derived strictly from processing tokens. Currently, these facilities are power-limited and memory-limited rather than compute-limited. Power density requirements are skyrocketing, forcing rack redesigns to support up to one megawatt—exceeding previous standards by 10 to 100 times.</p><p>Supply chains are already buckling under this pressure. Sobey pointed to a historic shortage in the memory sector, specifically for high-performance server memory, with reports of a 70% fulfillment rate for orders and price surges of up to 50%. Securing necessary memory inventory is becoming increasingly difficult for all but the largest hyperscalers.</p><p><b>Chiplets: the gateway for MRAM and RRAM</b></p><p>Sobey identified this supply/power crunch as a strategic entry point for &#34;alternative memories&#34;—technologies like MRAM (magnetoresistive RAM), RRAM (resistive RAM), and phase change memory (PCM) that lack the dedicated, multi-billion-dollar fabs of incumbents.</p><p>The chiplet architecture is the critical enabler for this transition. By disaggregating functions from monolithic ASICs into smaller units, chiplets allow designers to integrate esoteric materials required for alternative memory without contaminating high-end logic fabrication processes. This heterogeneous integration allows for specific performance advantages, such as radiation tolerance or high-temperature resilience, which Sobey argues are necessary differentiators beyond simple cost claims.</p><p><b>The new &#34;five-second rule&#34;</b></p><p>The velocity of AI is also compressing economic rules of thumb. Sobey observed that the long-standing &#34;five-minute rule&#34;—which dictates data should be kept in DRAM if accessed within five minutes—has accelerated to a &#34;five-second rule.&#34; In the AI era, if data is not accessed within five seconds, the cost-benefit analysis dictates it must be ejected from expensive, fast memory tiers.</p><p>Sobey said the current surge in AI is no mere ripple but a gathering wave, arguing that suppliers need to secure their positions now if they hope to retain an edge when pricing and supply chains eventually settle.</p><p>Sobey will discuss the impact of chiplets on the memory-storage hierarchy further during the <b><i>DIGITIMES webinar</i></b> on December 5, 2025, and at the <b>Chiplet Summit</b> in Santa Clara, California, scheduled for February 17–19, 2026.</p><p>SOURCE DIGITIMES ASIA</p><p><img src="https://imageproxy.pbkrs.com/https://rt.prnewswire.com/rt.gif/query-RGF0ZUlkPTIwMjUxMjAxJk5ld3NJdGVtSWQ9SEszNjk0NCZUcmFuc21pc3Npb25fSWQ9MjAyNTEyMDEyMTUwUFJfTkVXU19VU1BSX19fX19ISzM2OTQ0?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" original-src="https://imageproxy.pbkrs.com/https://rt.prnewswire.com/rt.gif/query-RGF0ZUlkPTIwMjUxMjAxJk5ld3NJdGVtSWQ9SEszNjk0NCZUcmFuc21pc3Npb25fSWQ9MjAyNTEyMDEyMTUwUFJfTkVXU19VU1BSX19fX19ISzM2OTQ0"/></p></div>       </div></div>

MRAM

<p>The rapid expansion of AI workloads is driving a fundamental redesign of data center infrastructure, causing memory shortages and opening opportunities for alternative memory technologies like MRAM and RRAM. Chuck Sobey highlights the unprecedented demands of AI systems on memory bandwidth and power density, leading to economic consequences and supply chain pressures. Chiplet architecture is identified as a key enabler for integrating alternative memories. Sobey will discuss these impacts further in upcoming events.</p>

- The rapid growth of artificial intelligence (AI) workloads is necessitating a redesign of data center infrastructure, leading to significant memory shortages and creating opportunities for alternative memory technologies.  
- AI systems demand unprecedented memory bandwidth, with requirements reaching up to 10 terabytes per second, which is drastically higher than traditional workloads, resulting in economic challenges and supply chain pressures.  
- Sobey emphasizes the importance of chiplet architecture in integrating alternative memory solutions and notes a shift in data access rules, urging suppliers to adapt quickly to maintain competitive advantages in the evolving market.

21:51 ET DIGITIMES ASIA: AI workload surge creates opening for alternative memory and chiplet technologies, expert says