Today, Barclays published a comparison of token consumption for inference traffic between Google and Microsoft, which is very interesting and even somewhat surprising for investors. The &#34;free&#34; model has led to a surge in demand, and the inference costs are significantly lower than expected.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/04f29be3-d506-40d7-90df-5930663682af.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/04f29be3-d506-40d7-90df-5930663682af.jpeg"/>
1. Absolute Leading Scale in AI Inference
In Q1 2025, Alphabet processed approximately 634 trillion (634T) tokens, while Microsoft processed about 100T; by April 2025, the monthly inference volume had risen to 480T, a staggering 50-fold increase from 9.7T a year ago, demonstrating that Google has a scale advantage in AI inference traffic that is six times that of Azure/ChatGPT.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/ac89ec92-de13-43c8-ab48-583d3fbf845b.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/ac89ec92-de13-43c8-ab48-583d3fbf845b.jpeg"/><img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/a7070365-68cf-437c-9450-3fb9f2e33a24.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/a7070365-68cf-437c-9450-3fb9f2e33a24.jpeg"/>
2. Growth Driver — Free AI Products Instead of Paid Subscriptions
The surge in inference volume primarily comes from free scenarios like AI Overviews in Search; the user base of Google Search is about 5-6 times that of ChatGPT, and the growth rate of free AI tokens (50×) far exceeds that of paid large model revenue growth (3-4×), highlighting Google's strategy of prioritizing users and data barriers before seeking monetization.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/2d2ef6c9-41b9-4c8d-add8-a967fa0c02b9.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/2d2ef6c9-41b9-4c8d-add8-a967fa0c02b9.jpeg"/>
3. Cost Impact Overestimated: Inference Costs Only Account for Approximately 1% of Search Revenue
Based on the Gemini 2.5 rate, the inference cost in Q1 2025 is estimated to be around $750 million, accounting for only approximately 1% of search revenue (1.6% of COGS + Opex); even if token consumption continues to rise at a rate of 4 times, it will still be lower than the core infrastructure costs of search (approximately 18% of revenue), alleviating market concerns about declining profit margins.
4. Capital Expenditure Structure: Primarily Training, Inference Only Uses Approximately 10%
Approximately 90% of Google's AI computing CAPEX is still directed towards training and new models, with the CAPEX for inference chips accounting for only 6.2% (approximately $600 million) in Q1 2025. If estimated based on a monthly run-rate of 480T, the inference CAPEX in Q2 2025 will only rise to approximately 14%, indicating that funding is still primarily betting on the long-term evolution of models.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/7061a67f-bc41-4802-96ec-4d78b137161b.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/7061a67f-bc41-4802-96ec-4d78b137161b.jpeg"/>
5. Hardware Efficiency: Approximately 270,000 TPUv6 can support current inference
Assuming a 50/50 Pro and Flash model with 15% Active Parameters, Google can cover the 1Q25 inference load with approximately 270k TPUv6 (ASP approximately $4,500), reflecting the advantages of self-developed accelerators in terms of power consumption and cost.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/20a5a94e-f687-4463-8b5b-b216831f4ce4.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/20a5a94e-f687-4463-8b5b-b216831f4ce4.jpeg"/>
6. Future Catalysts: Astra, Mariner, Veo and other agent-based applications
The yet-to-be-fully-scaled general AI assistant (Project Astra), browser agent (Mariner), and video generation model (Veo) are expected to further increase the token base. Google has proactively raised Compute CAPEX to over 50% of total CAPEX, laying the groundwork for incremental elasticity in AI demand after 2026.
<img src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/6a698b84-26d4-4ecd-a457-81b0b381a1e8.jpeg?x-oss-process=image/auto-orient,1/interlace,1/resize,w_1440,h_1440/quality,q_95/format,jpg" alt="" original-src="https://imageproxy.pbkrs.com/https://wpimg-wscn.awtmt.com/6a698b84-26d4-4ecd-a457-81b0b381a1e8.jpeg"/>

GOOG

MSFT

The inference cost is significantly lower than expected

- Barclays' comparison of Google and Microsoft's token consumption in AI inference reveals surprising insights for investors.  
- Google leads significantly in AI inference, processing approximately 634 trillion tokens in Q1 2025, compared to Microsoft's 100 trillion, driven mainly by free AI products.  
- The cost of inference is estimated at only 1% of search revenue, alleviating concerns about profit margin declines, while Google continues to invest heavily in training and new models.  

Wallstreetcn

Google's token consumption has increased 50 times in a year, now 6 times that of Microsoft/ChatGPT