@SemiAnalysis

How do different operating systems and microarchitectures affect the end user experience with agentic AI?

NPO presents an interim solution under the transition from pluggable to true CPO. NPO has certain benefits over CPO that bypass current production and reliability challenge of CPO, while maintaining most of the benefits CPO provide.

THIS IS AN ENGAGEMENT BAIT & HOT TAKE 🚨Percy Jackson is a better movie than Odyssey in terms of storytelling. Odyssey is one of Christopher Nolan's worst films. The storytelling was so poor that they had to distract viewers by adding IMAX 70mm cameras.

Most of AMD’s top 10x AI engineers are in Shanghai 🔥 This includes AMD’s MoRI collective and UMBP KV-cache offloading and pooling team, its disaggregated-applications forward-deployed engineering team, and other AMD teams that understand how to approach inference engineering from first principles.

The datacenter fight in the US has so far run through county boards and city councils. But that ended on July 14, when Gov Kathy Hochul signed Executive Order 62 and New York became the first state to implement a datacenter moratorium. (1/5)🧵

SemiAnalysis Datacenter team tracks all dc sites. Datacenter team started noticing new builds missing the gensets. Datacenter team checked the Industrials Model and now tracks 15GW+ of capacity with no gensets, no central UPS, or neither. (1/3)🧵

How often does Claude use tools?

We believe the MI455 is the first known chip to ship with active Local Silicon Interconnect (LSI) bridges, the chiplet-to-chiplet links inside a CoWoS-L package.

AMD MI355X vLLM HAS BEATEN B200 vLLM ON KIMI K2.5 (THE SAME MODEL ARCH AS XAI CURSOR COMPOSER 2.5)🚀🚨

Indium Phosphide (InP) LASERs are suddenly catching everyone's interest since it suddenly became one of the more strategic components in computing. As optical connectivity moves ever closer to the package, every optical engine and laser source inevitably runs on InP LASERs. But supply isn't keeping up with demand, particularly for Continuous Wave (CW) Distributed Feedback (DFB) LASERs which enable near-package optical connectivity. (1/2)🧵

Ever wonder why PCB folks throw around "M8" or "M9" like a spec sheet magic word?

GREAT WORK BY @GPU_MODE 🚨 FOR LAUNCHING THE $1.1mil AMD KERNEL HACKATHON.

The Wild Wild West Of LEGO Datacenters

AMD's warrant deals with OpenAI and Meta usually get described as equity sweeteners. Run the math, and these look more like a rebate that matches the price of the compute itself, with up to a 105% discount for OpenAI. (1/3)🧵

Vera Rubin NVL72 vs GB200 NVL72? Inference TCO & Architecture Analysis:

ALERT🚨🚨: META's CUSTOM AMD MI400-series chip will be half the size of a normal MI455X chip. It is "optimized" for recsys workloads and $/Memory Bandwidth. It will use ~144GB of HBM instead of 432GB. We break it down below👇️ 1/7🧵

Datacenters have always kept reciprocating engines on site as emergency standby, kicking in when the grid drops and running a handful of hours a year. That role is changing, as recips are increasingly being repurposed to prime power, energizing datacenters around the clock. We estimate that recip OEMs (e.g., Caterpillar, INNIO, Cummins) have been contracted to supply ~1 GW of BTM power this year, and 4+ GW in each of 2027 and 2028. Our SemiAnalysis Energy Model tracks these BTM contracts OEM-by-OEM, project-by-project. Yet, that is dwarfed by the opportunity to come. (1/3)🧵

Great work by the AMD @sgl_project team on enabling nightly disaggregated serving CI to improve code quality! It has already caught and prevented 2 massive bugs from reaching customers, as we explained before 👇️ 1/7🧵

Similar to the panic over DeepSeek R1, some uneducated people think Kimi K3’s use of linear attention (KDA) is bad for NVIDIA, HBM, DRAM, and networking because it has relatively lower KV-cache requirements. The opposite is true, and we explain why below. 👇️ 1/8🧵

BREAKING: Broadcom is diversifying away from long-time foundry partner TSMC. Lego will be the new manufacturing partner for Broadcom's flagship hyperscaler ASIC products in 2028. Broadcom President of Semiconductor Solutions, Charlie Kawwas, has already showed off package samples at RAISE Summit in Paris last week. With TSMC supply constrained, customers are alternative sources of chip supply from unexpected places. One of the major differentiators Lego brings is industry leading defect repair, "plug and play" chiplet interoperability, as well as built in self-alignment technology for 3D stacking. Mattel and Hasbro were also under consideration, but Lego's proven track record won out in the end. We have ordered multiple Millennium Falcon Sets set to our Portland teardown lab for competitive teardown analysis.