If the iPhone redefined smartphones, can &#34;Apple Intelligence&#34; have the opportunity to redefine terminal AI?
Renowned Apple analyst Ming-Chi Kuo gave an affirmative answer.
In an article released on Wednesday, Ming-Chi Kuo stated that currently, the AI capabilities of the Samsung S24 phone are still relatively limited, and Microsoft's AIPC has not provided consumers with a clear understanding, leaving only Apple to redefine terminal AI.
<blockquote>
At least Apple has successfully conveyed to the public the rich features and unique selling points of its terminal AI.
</blockquote>
Ming-Chi Kuo believes that Apple's success in terminal AI is likely to inspire other tech companies to accelerate their research and innovation in this field, leading to industry-wide competition and rapid imitation and follow-up. This competitive situation will further drive the accelerated growth of various industries related to device-side AI.
Ming-Chi Kuo also pointed out that the current &#34;Apple Intelligence&#34; terminal AI large model requires approximately 2GB or less of DRAM (Dynamic Random Access Memory).
<h2>Defining Terminal AI with &#34;Apple Intelligence&#34; from the Supported Models</h2>
According to Apple's previous introduction, the iPhone 15 equipped with the A16 processor cannot support &#34;Apple Intelligence,&#34; but devices with the M1 chip can support this feature.
This indicates that the key factor determining whether a device can support &#34;Apple Intelligence&#34; should be the size of DRAM, rather than AI computing power (usually measured in TOPS, i.e., trillions of operations per second).
Ming-Chi Kuo estimates that the AI computing power of M1 is about 11 TOPS, lower than A16's 17 TOPS, but A16's DRAM is 6GB, lower than M1's 8GB. Therefore, the current &#34;Apple Intelligence&#34; terminal AI large model requires approximately 2GB or less of DRAM.
To run applications on AI-enhanced devices, the device needs to be able to run large models with a parameter scale of 3 billion. The specific capacity of DRAM required depends on the model compression method used.
Ming-Chi Kuo points out that Microsoft considers 40 TOPS computing power as a key specification for AIPC, but for Apple, 11 TOPS combined with cloud AI is sufficient to provide rich device-side AI applications.
If consumers want to purchase Microsoft's AIPC, they need to calculate whether it meets the 40 TOPS requirement, while Apple directly informs consumers which models can support &#34;Apple Intelligence,&#34; giving them a sales strategy advantage.
In the future, &#34;Apple Intelligence&#34; terminal AI will definitely be upgraded (most likely to a large model with 70 billion parameters), which will require larger DRAM to operate.
By then, will Apple use the upgrade of device-side AI to further differentiate its product line? Additionally, whether the user experience is as good as Apple claims remains to be seen

AAPL

"At least Apple has successfully conveyed to the public the rich features and unique selling points of its terminal AI," Guo Mingchi pointed out, currently, the "Apple Intelligence" terminal AI large model requires about 2GB or less of DRAM

The main points conveyed by the author are as follows:1. Apple has the opportunity to redefine terminal AI, just as the iPhone redefined smartphones.2. Apple has successfully communicated the rich functionality and unique selling points of its terminal AI to the public.3. The success of Apple in terminal AI is likely to inspire other tech companies to accelerate their research and innovation in this field, leading to industry-wide competition and growth.4. The key factor determining whether a device can support Apple's terminal AI is the size of the DRAM, not the AI computing power.5. Devices equipped with the M1 chip can support Apple's terminal AI, while those with the A16 processor cannot.6. The current large model of Apple's terminal AI requires approximately 2GB or less of DRAM.7. The AI computing power of the M1 chip is estimated to be around 11 TOPS, while the A16 chip has 17 TOPS. However, the A16 chip has 6GB of DRAM, while the M1 chip has 8GB.8. The minimum requirement for running AI-enhanced applications on devices is a model size of 3 billion parameters.9. Apple's terminal AI with 11 TOPS and cloud AI is sufficient to provide rich device-side AI applications, while Microsoft considers 40 TOPS computing power as a key specification for its AIPC.10. Apple's sales strategy of directly informing consumers which models can support its terminal AI gives it an advantage over Microsoft, where consumers need to calculate if their device meets the 40 TOPS requirement.11. In the future, Apple's terminal AI will likely be upgraded to a larger model with 7 billion parameters, requiring larger DRAM to operate.12. It remains to be seen if Apple will use the upgrade of device-side AI to further differentiate its product line and if the user experience will be as good as claimed.

"Apple's Most Knowledgeable" analyst Ming-Chi Kuo: "Apple Intelligence" is expected to redefine terminal AI