Shares of memory and storage-related companies, including Micron Technology Inc (NASDAQ:MU) and SanDisk Corp (NASDAQ:SNDK), are trading lower on Wednesday.



The move follows a technical announcement from Alphabet Inc's (NASDAQ:GOOGL) (NASDAQ:GOOG) Google Research regarding AI efficiency.



<h2>Google Unveils TurboQuant Algorithm</h2>



On Tuesday, Google researchers introduced &#34;TurboQuant.&#34; This set of advanced quantization algorithms enables massive compression for large language models (LLMs).



According to the Google blog, the technology &#34;optimally addresses the challenge of memory overhead in vector quantization.&#34;



The breakthrough focuses on the key-value (KV) cache. Google describes this as a &#34;digital cheat sheet&#34; that stores frequently used information.



High-dimensional vectors capture complex AI data but consume vast amounts of memory. Google reported that TurboQuant reduces key-value memory size &#34;by a factor of at least 6x&#34; without sacrificing model accuracy.



<h2>Enhanced Efficiency For LLMs</h2>



TurboQuant utilizes two secondary methods: PolarQuant and Quantized Johnson-Lindenstrauss (QJL). In testing with open-source models like Gemma and Mistral, the system achieved an &#34;8x performance increase&#34; over unquantized keys on NVIDIA Corp.'s (NASDAQ:NVDA) H100 GPU accelerators.



Google stated these techniques allow &#34;building and querying large vector indices with minimal memory.&#34;



Price Action: SanDisk shares were down 3.17% at $649.20, Western Digital shares were down 1.29% at $291.80, and Micron Technology shares were down 3.46% at $381.86 at the time of publication on Wednesday, according to Benzinga Pro data.



Photo: Nor Gal / Shutterstock

FTXL

SOXX

Memory stocks, including Micron Technology (MU) and SanDisk (SNDK), fell following Google's announcement of TurboQuant, an AI compression method that significantly reduces memory overhead for large language models (LLMs). TurboQuant can decrease key-value memory size by at least 6x while maintaining accuracy, leading to lower hardware demand. As a result, SanDisk shares dropped 3.17%, Western Digital fell 1.29%, and Micron decreased by 3.46% on Wednesday.

- Shares of memory and storage-related companies, including Micron Technology Inc and SanDisk Corp, are trading lower following Google's announcement of its TurboQuant algorithm.  
- The TurboQuant technology aims to optimize memory usage for large language models, significantly reducing key-value memory size by at least 6x while maintaining accuracy.  
- This advancement allows for enhanced efficiency in building and querying large vector indices, leading to an 8x performance increase in tests with certain open-source models.

benzinga_article

Direxion Daily MU Bull 2X Shares

First Trust Nasdaq Food & Semicon

iShares Semiconductor ETF

Invesco Semiconductors ETF

Micron Tech

GraniteShares 2x Long MU Daily ETF

Direxion Semicon Bull 3X

Alphabet

Direxion Daily GOOGL Bull 2X Shares

VanEck Semiconductor ETF

Alphabet - C

SPDR S&P Semicon

Western Digital

Sandisk

Invesco PHLX Semiconductor ETF

Memory Stocks Slide As Google's New AI Efficiency Breakthrough May Slash Data Storage Needs