<div id="readability-page-1"><div><div><p><strong>Alibaba Group Holding</strong> (NYSE:BABA) has introduced a new computing pooling system called Aegaeon, which dramatically reduces the reliance on <strong>Nvidia</strong> (NASDAQ:NVDA) GPUs by 82% for AI models.</p><h2><strong>Three Months In Testing</strong></h2><p>This innovation was tested in Alibaba Cloud's model marketplace for over three months, according to a research paper presented this week at the 31st Symposium on Operating Systems Principles (SOSP) in Seoul, South Korea.</p><p>The Aegaeon system has successfully decreased the number of Nvidia H20 GPUs required from 1,192 to just 213 for serving models with up to 72 billion parameters.</p><p>&#34;Aegaeon is the first work to reveal the excessive costs associated with serving concurrent LLM workloads on the market,&#34; the researchers stated in the paper.</p><p>Researchers from <strong>Peking University</strong> and Alibaba Cloud emphasized the high costs associated with serving concurrent large language model workloads.</p><h2><strong>One GPU For Multiple Models</strong></h2><p>Alibaba Cloud, the AI and cloud services division of the Hangzhou-based Alibaba, aims to boost efficiency by pooling GPU resources, allowing a single GPU to support multiple models.</p><p>The system addresses resource inefficiency, as previously, 17.7% of GPUs were allocated to serve only 1.35% of requests in Alibaba Cloud's marketplace.</p><p>Cloud service providers like Alibaba Cloud and <strong>ByteDance</strong>‘s Volcano Engine manage thousands of AI models simultaneously, often leading to inefficiencies. The Aegaeon system seeks to optimize this process by reducing the number of GPUs needed.</p><h2><strong>Growing Concerns Over Nvidia's China Presence</strong></h2><p>This development comes amid growing concerns over Nvidia’s presence in China. Recently, China raised security concerns about Nvidia’s H20 chips, especially regarding potential backdoor risks. As part of its deal with Nvidia, the Trump administration has struck an agreement for a 15% revenue share from the company's chip sales to China.</p><p>Nvidia CEO <strong>Jensen Huang</strong> stated that Nvidia’s market share in China has plummeted from 95% to zero. He expressed concerns over the impact of U.S. policies on Nvidia’s market presence in China.</p><p>Despite these challenges, Nvidia has financially insulated itself from potential escalations, as its guidance assumes zero revenue from China, according to Huang.</p><ul> <li><strong>Elon Musk Says 100K People, 1 Million Tons Of Cargo Needed To Sustain Mars Colonies, Reiterates Starship’s Importance: ‘Will Land Humans On Mars’</strong></li> </ul><p><em>Photo courtesy: Shutterstock</em></p></div></div></div>

BABA

09988

KBAB

BABO

BABX

<p>Alibaba Cloud has launched Aegaeon, a new computing pooling system that reduces Nvidia GPU usage by 82% for AI models. Tested for over three months, it decreases the number of required Nvidia H20 GPUs from 1,192 to 213 for models with up to 72 billion parameters. This innovation aims to enhance efficiency by allowing a single GPU to support multiple models, addressing resource inefficiencies. The development occurs amid concerns over Nvidia's presence in China and the impact of U.S. policies on its market share.</p>

- Alibaba Group has launched Aegaeon, a computing pooling system that reduces reliance on Nvidia GPUs by 82% for AI models.  
- Tested for over three months, Aegaeon decreases the number of required Nvidia H20 GPUs from 1,192 to 213, addressing inefficiencies in resource allocation.  
- This development occurs amid concerns over Nvidia's presence in China, where security issues have led to a significant decline in its market share.  

Benzinga

Alibaba

BABA-W

KraneShares 2x Long BABA Daily ETF

YieldMax BABA Option Income Strategy ETF

BABA 2x Long Daily ETF - GraniteShares

Alibaba Cloud's New System Cuts Nvidia GPU Usage By 82%, Amid Trump's Flip Flop On AI Chip Ban On China