<div id="readability-page-1"><span></span><div><p>In the increasingly competitive AI chip market, there's another startup in production that claims an advantage over Nvidia, the world's most valuable company.</p><p>D-Matrix, located three miles away from Nvidia's Silicon Valley headquarters, says its chips can run inference workloads 10 times faster and using five times less energy than a standalone graphics processing unit from the market leader — as long as the workloads are small.</p><p>The new inference chip, called Corsair, takes a novel approach to memory that's similar to Cerebras and Groq. With tech giants demanding all the computing resources they can get their hands on, it's becoming clear that there's substantial opportunity for smaller players to find their niche.</p><p>Cerebras, founded in 2015, held a blockbuster IPO last month, raising over $5.5 billion, and is now valued at over $50 billion. And Groq's assets were bought by Nvidia for $20 billion in December, making it the AI giant's largest purchase to date. Nvidia then released a new Groq chip at GTC in March, called a language processing unit.</p><p>&#34;This is a $1 trillion market in the making,&#34; D-Matrix co-founder and CEO Sid Sheth told CNBC in an interview, adding that he has no intention of selling the company. &#34;Can the market support yet another public company? Absolutely.&#34;</p><p>Founded in 2019, D-Matrix has raised around $500 million so far, putting it at around a $2 billion valuation. Microsoft was one of the investors, through its M12 venture arm. That's notable because of Microsoft's own chip ambitions, including its Maia 200 chip for AI inference, new PC processors built with Nvidia, and an in-house quantum computing chip announced last week.</p><p>Sheth won't name Corsair customers yet, but said he has commitments from high-profile hyperscalers, neoclouds and frontier AI labs eager to get their hands on as much compute as possible. D-Matrix begins shipping to those customers this month. About 90% of customers are in the U.S., while overseas customers are in the Middle East and Southeast Asia, Sheth said.</p></div><div id="ArticleBody-InlineImage-108314499"><div><div><p>Jensen Huang, chief executive officer of Nvidia Corp., presents the RTX Spark Superchip at the Nvidia GTC conference on the sidelines of Computex 2026 in Taipei, Taiwan, on Monday, June 1, 2026. </p><p>Lam Yik Fei | Bloomberg | Getty Images</p></div></div></div><div><p>&#34;Quite often they sell to customers to use this stuff in conjunction with Nvidia,&#34; said semiconductor analyst Stacy Rasgon of Bernstein Research, adding that the different chips are better at different tasks. &#34;Sounds like he's got a fair number of actual, real customer engagements.&#34;</p><p>D-Matrix's Corsair chip achieves low latency inference on low power by tightly integrating memory and compute on a single chip. </p><p>Like Groq and Cerebras, D-Matrix relies on SRAM, a type of memory that can be made at logic fabs like Taiwan Semiconductor Manufacturing Company and integrated on the same chip. GPUs rely on large amounts of another kind of memory called DRAM that's packaged into stacks of high bandwidth memory added around the logic chip.</p><p>That DRAM is also what's in short supply from <span id="RegularArticle-QuoteInBody-10">Micron<span><span id="-WatchlistDropdown"></span></span></span>, Samsung and SK Hynix.</p><p>&#34;We're not running into a chokepoint around DRAM with our product because our product doesn't really rely on DRAM to be successful,&#34; Sheth said.</p><p>The big downside to D-Matrix's approach is that SRAM can't handle massive reasoning models, according to Rick Bahr, adjunct professor of electrical engineering at Stanford University.</p><p>While on-chip SRAM enables &#34;remarkable inference speeds&#34; because data has to travel such short distances, it can't handle the trillions of parameters that now make up large models from leaders like OpenAI and Anthropic.</p><p>&#34;That number of parameters just simply can't be be put onto an SRAM-based design,&#34; Bahr said. &#34;That's the big challenge.&#34;</p><p>Sheth says Corsair is designed for AI inference, where &#34;you're optimizing for interactivity or speed&#34; over language size. Think chatbots, video generation and agentic tools like Claude Code and OpenClaw.</p><p>When paired with an Nvidia Blackwell GPU, D-Matrix says, citing research from Gimlet Labs, that Corsair can run inference 10 times faster, three times cheaper and up to five times more energy efficiently than a standalone GPU.</p></div><div><div id="RegularArticle-RelatedContent-1"><div><div><h2>Read more CNBC tech news</h2><div><ul><li>OpenAI confidentially files for IPO, prepping Wall Street for mega AI debut</li><li>Apple partnering with Google and Nvidia for most advanced AI model</li><li>Silicon Valley's new buyout playbook is hitting Wall Street</li><li>Everything from WWDC: Apple's big Siri AI reveal, Liquid Glass changes and more</li></ul></div></div></div></div></div><div><p>Nvidia CEO Jensen Huang said last week that his company remains the leader in low-cost inference with its leading Vera Rubin system because it's not just about speed.</p><p>At Computex in Taiwan, Huang said &#34;the reason for that is we integrate everything, we design everything from the ground up, we simulate the entire system and we use extreme co-design.&#34;</p><p>D-Matrix sells four Corsair chips packaged together inside a card that slides into slots in a data center server rack and costs tens of thousands of dollars, Sheth said. </p><p>It's a plug-and-play approach that differentiates D-Matrix from Cerebras and Groq, according to Sheth, who called Corsair the &#34;densest SRAM solution in the market today,&#34; with up to 128 gigabytes of SRAM memory in a single server.</p><p>D-Matrix also teamed up with Arista, Broadcom and <span id="RegularArticle-QuoteInBody-13">Super Micro<span><span id="-WatchlistDropdown"></span></span></span> to build a full rack-scale system called SquadRack for deploying its chips in AI data centers.</p><p>The chip is made in Taiwan on TSMC's 6-nanometer node. D-Matrix's next chip, Raptor, is scheduled to launch next year on TSMC 4 nanometer, which Sheth said could run out of the Taiwanese company's factory in Arizona.</p><p>&#34;Building a computing solution for AI inference is going to be the grand prize,&#34; Sheth said.</p><p>WATCH: From GPUs to TPUs, here's how the top AI chips work</p></div><div><p>Choose CNBC as your preferred source on Google and never miss a moment from the most trusted name in business news.</p></div></div>

NVDA

NVDY

NVDQ

<p>D-Matrix, a Microsoft-backed AI chip startup, has entered full production of its Corsair inference chip. Claiming to be 10 times faster and more energy-efficient than standalone Nvidia GPUs for small workloads, the chip uses SRAM to bypass DRAM shortages. While limited in handling massive models, it targets specific inference tasks like chatbots, with shipments beginning this month to hyperscalers and AI labs.</p>

- D-Matrix, a startup located near Nvidia, claims its Corsair chip can outperform standalone GPUs in inference workloads by being ten times faster and five times more energy-efficient for smaller tasks.  
- The company, backed by significant investment and partnerships, begins shipping to various high-profile customers while emphasizing its unique architecture that integrates memory with compute, diverging from traditional DRAM reliance.  
- However, limitations exist as SRAM cannot accommodate extremely large AI models, posing a significant challenge for broader applications in the competitive AI chip market.

CNBC

NVIDIA

YieldMax NVDA Option Income Strategy ETF

T-Rex 2X Inverse NVIDIA Daily Target ETF

XL2CSOPNVDA

AXS 1.5X NVDA Bear Daily ETF

Direxion Daily NVDA Bear 1X ETF

GraniteShares 2x Long NVDA Daily ETF

T-Rex 2X Long NVIDIA Daily Target ETF

Direxion Daily NVDA Bull 2X Shares

XI2CSOPNVDA

GraniteShares 2x Short NVDA Daily ETF

ProShares Ultra NVDA

Leverage Shares 2X Long NVDA Daily ETF

Leverage Shares 2x Cpd Acclrtd NVDAMnETF

NVDA WeeklyPay ETF - Roundhill

GraniteShares YieldBOOST NVDA ETF

xETFs NVDA Daily Income ETF

VanEck Semiconductor ETF

iShares Semiconductor ETF

Direxion Semicon Bull 3X

Invesco PHLX Semiconductor ETF

SPDR S&P Semicon

Invesco Semiconductors ETF

First Trust Nasdaq Food & Semicon

Microsoft

Cerebras

Taiwan Semiconductor

Micron Tech

OpenAI

Apple

Alphabet

Alphabet - C

NVIDIA Corporation

Upstart chipmakers keep challenging Nvidia. This time it's Microsoft-backed D-Matrix