SUMMARY
- New Chip on the Block: Nvidia's GH200 brings a powerful GPU paired with 141 gigabytes of cutting-edge memory, designed specifically for AI inference.
- Market Dominance Continues: With over 80% market share, Nvidia's latest innovation aims to solidify its position against competitors like AMD, Google, and Amazon.
- Availability and Application: Launching in Q2 next year, the GH200 offers potential to reduce the computational costs and processing power required for AI models, making it a must-watch release.
Nvidia Raises the Game with a New AI Chip
Nvidia has unveiled its latest innovation on Tuesday: a chip created specifically to run artificial intelligence (AI) models. This move comes as the company aims to stay ahead of competitors like AMD, Google, and Amazon in the increasingly competitive AI hardware market.
Currently reigning as the king of AI chips with over 80% market share, Nvidia is renowned for its graphics processing units (GPUs). These GPUs are highly sought after for powering large AI models, like Google’s Bard and OpenAI's ChatGPT. However, these chips are becoming scarce as everyone from tech giants to startups scramble to get their hands on them.
Introducing the GH200, Nvidia's latest AI marvel. It's similar to the company's previous top-tier AI chip, the H100, but it brings to the table 141 gigabytes of state-of-the-art memory and a robust 72-core ARM central processor. In the words of Nvidia CEO Jensen Huang, "We're giving this processor a boost. This processor is designed for the scale-out of the world's data centers."
Availability is set for the second quarter of next year, and sampling should commence by the year's end. Though Nvidia is tight-lipped about the price, there's already a buzz surrounding this chip. Designed to streamline the labor-intensive processes of AI training and inference, it has ample memory to manage more extensive AI models without requiring multiple systems.
"This new chip will inference like crazy," says Huang, emphasizing its cost-effective capability. It allows even the largest AI models to fit into a single system, a feat that will surely appeal to industry giants and startups alike. With rivals like AMD unveiling their own AI chips, Nvidia's GH200 sets a new standard, solidifying the company's place at the top of the AI hardware pyramid.
WOM Money Picks
Be a part of the winning team | 81% Success Rate.