Elon Musk's AI company, xAI, has launched Colossus, an AI training system featuring 100,000 NVIDIA H100 graphics cards.

Colossus consists of 100,000 liquid-cooled NVIDIA H100 GPUs linked on a single network fabric. The H100 can run language models up to 30x faster than previous-generation GPUs. It features a Transformer Engine module optimized for AI models based on the Transformer neural network architecture.

xAI plans to expand Colossus to 200,000 GPUs in the coming months, including 50,000 H200s, which are faster versions of the H100. The company claims this expansion will further enhance the system's capabilities, potentially facilitating the development of language models with significantly improved performance compared to their current Grok-2 model.

Analyst QuickTake: xAI launched Grok-2 and Grok-2 mini with image generation last month, offering enhanced capabilities in chat, coding, and reasoning. xAI's flagship offering, Grok, is offered exclusively on the X platform and competes with OpenAI’s ChatGPT.