Musk: The next-generation large model Grok 3 will require 100,000 NVIDIA H100 chips

Wallstreetcn
2024.04.10 01:31
portai
I'm PortAI, I can summarize articles.

Elon Musk expects that the next generation large-scale model Grok 3 will require 100,000 NVIDIA H100 GPUs, with potential power consumption equivalent to that of a small city. Musk pointed out that the current development of AI technology faces two major challenges: a shortage of high-end GPUs and enormous power demand. Nevertheless, advancements in computing and storage technology will make it possible to train even larger language models in the coming years. Musk predicts that an artificial intelligence smarter than the most intelligent human will be born in the next one to two years