SUMMARY

• Nvidia's H100 processors are in high demand due to their optimization for AI architecture called transformers.
• The prices for H100s are soaring and are being sold for more than $40,000 on eBay.
• Developers are using H100s to build large language models (LLMs) which are at the core of AI applications like OpenAI's ChatGPT.

Hey there! Have you heard about the latest craze in the tech world? No, it's not a new iPhone or a fancy smartwatch, it's actually the demand for Nvidia's H100 processors! These bad boys are selling like hotcakes on eBay for a whopping $40,000 - $46,000. Yeah, you read that right.

John Carmack, a 3D gaming pioneer and former Meta consulting technology chief, took to Twitter to share the news of these eye-watering prices. Apparently, the H100 is the latest flagship AI chip from Nvidia, following in the footsteps of the A100, which goes for a more modest $10,000. The H100 is being used to build what are known as large language models (LLMs), which are at the core of AI applications like OpenAI's very own ChatGPT.

Training these AI models requires a ton of computing power, and that's where Nvidia's H100 comes in. By using hundreds of high-end Nvidia GPUs working together, developers can power through terabytes of data in no time, generating text, images, and predictions that would otherwise take weeks to complete.

The H100 is optimized for a specific AI architecture called transformers, which is the secret sauce behind many of the recent advances in AI. Experts predict that even more powerful chips will be needed in the future to build even bigger and more data-hungry models than the ones we have now.

Microsoft, for example, spent hundreds of millions of dollars on tens of thousands of Nvidia A100 chips to help build ChatGPT. Nvidia pretty much has a monopoly on the AI chip market, with no real competition in sight.

If you don't have a spare $40k lying around, don't worry. Nvidia also offers a supercomputer called the DGX, which comes equipped with eight GPUs working together. They even offer rental services for companies to access the DGX computers for a mere $37,000 per month! Bargain, right?

In conclusion, the demand for Nvidia's H100 processors is through the roof, with prices to match. But, hey, if you want to train your own AI model and have money to burn, why not treat yourself to one? It's the ultimate tech flex!

WOM Money Picks

Be a part of the winning team | 81% Success Rate.