An article from The Information reported that Elon Musk has been discussing with investors this month about the plan to build a supercomputer to support xAI at his artificial intelligence company, the creator of the Grok model.
Musk told investors that this construction plan will be a Gigafactory of Compute, housing multiple NVIDIA H100 GPUs, and will require billions of dollars in collaboration with Oracle for development. The goal is to have it completed by the end of 2025.
Currently, the available Grok model for use is version 1.5, with the next version, Grok 2, needing at least 20,000 GPUs, while Grok 3 will require a minimum of 100,000 GPUs.
Source: The Information
TLDR: Elon Musk plans to build a Gigafactory of Compute with NVIDIA H100 GPUs for xAI support, in collaboration with Oracle, expecting completion by 2025. Grok models require thousands of GPUs for processing power.
Leave a Comment