
Google Releases KV Cache Compression Technology, Impacting Storage Demand Expectations, US Storage Stocks Plunge Collectively

I'm LongbridgeAI, I can summarize articles.
Google has introduced a new memory compression technology, TurboQuant, which can compress the key-value cache of large language models to 3 bits, achieving a 6x memory reduction and up to 8x acceleration. This has sparked market concerns about the outlook for storage demand, leading to a collective plunge in storage chip stocks such as SanDisk, Micron, and Western Digital on Wednesday. Morgan Stanley analysis suggests that this technology only affects the inference stage and does not reduce hardware demand; instead, it may activate more AI application scenarios by lowering deployment costs
Log in to access the full 0 words article for free
Due to copyright restrictions, please log in to view.
Thank you for supporting legitimate content.

