BofA: China Semiconductors
> Shift to System-Level Supernodes: China's leading AI accelerator and infrastructure vendors are shifting focus from standalone chip performance to system-level integration through broad product launches of rack-scale supernodes ranging from 64 cards to over 1,000 cards (e.g., Huawei and Biren architectures). This strategy helps offset individual chip performance gaps via higher density, faster interconnects, and parallel computing. > PCle Switch Demand Growth: Most supernode compute trays feature a high XPU-to-switch ratio of 2:1 (two PCIe switches for every four GPUs), driving meaningful demand for PCIe switches to handle increased density and complex I/O configurations within compute trays. > Expansion of Edge AI and AIoT: Edge AI is expanding past smartphones and PCs into broader AIoT categories like AI glasses, toys, audio products, vehicle boxes, industrial terminals, and robots. Architectures combining host processors with edge AI coprocessors (such as Rockchip's dual-chip design) are raising semiconductor content value per device. > Implications of Kimi K3: Moonshot AI's launch of Kimi K3 validates sustained infrastructure demand with its 2.8-trillion-parameter Mixture of Experts (MoE) architecture, native multimodal capabilities, and 1M-token context window. > Increased Hardware & Memory Demands from K3: K3's scale increases high bandwidth memory (HBM) capacity needs (requiring about 1.4TB of raw model storage before caches and buffers), while its jump to 896 experts and 16 active experts per token places a heavy premium on memory bandwidth, efficient expert routing, and scale-up interconnect efficiency.$Micron Tech(MU.US) $DRAM $EWY
The copyright of this article belongs to the original author/organization.
The views expressed herein are solely those of the author and do not reflect the stance of the platform. The content is intended for investment reference purposes only and shall not be considered as investment advice. Please contact us if you have any questions or suggestions regarding the content services provided by the platform.
Post your comment
No Comments