Comments on: How To Make More Money Renting A GPU Than Nvidia Makes Selling It https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Tue, 14 May 2024 02:42:49 +0000 hourly 1 https://wordpress.org/?v=6.5.5 By: Timothy Prickett Morgan https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223951 Sat, 04 May 2024 12:38:44 +0000 https://www.nextplatform.com/?p=144092#comment-223951 In reply to Alex argonaut.

Oh, I see the absurdity alright. But Google and Meta — and AWS and Microsoft to a lesser extent — are using this iron to drive ad revenues or search revenues already. Google search has had AI behind it for many years, for instance. Microsoft is the most hopeful of them all, clearly. Some of these GPUs — maybe half of the H100s — are being used to drive the quest for AGI, which is more like HPC for its own sake and is something closer to R&D. The idea, I think, is replacing $1 trillion or so in annual people costs with $500 billion in AI system costs that is amortized over, what?, five years? That is 10X savings. Until you realize now there is $1 trillion in spending that will go missing, with obvious network effects rippling through the economies of the world. And the answer? More AI! And so on, and so on. So yeah, I see the absurdity of it all, Alex.

]]>
By: Alex argonaut https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223938 Sat, 04 May 2024 02:35:12 +0000 https://www.nextplatform.com/?p=144092#comment-223938 Every single analysis I have seen focuses on supply and assumes there is an ROI for people spending money in training and other AI activities. No letex extrapolate this funny marh to the expected 50b of nvdiia GPU system sales and add another 10b for TPU, AMD MI series etc. Based on your math, somehow this 60b of GPUs will generate $420b of revenue (since 800m of H100s are projected to generate $5B+). Do you see the absurdity? Total revenue from the applications layer (openai, anthropic, Microsoft office copilot) etc is less than $10b and even if it doubles every year for the next 3 years it will be at $80b far short of the $400b needed to even support the current level of capex…

]]>
By: Carl Schumacher https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223927 Fri, 03 May 2024 20:44:58 +0000 https://www.nextplatform.com/?p=144092#comment-223927 1.21 GigaWatts:: Enough power for?: A circa 2025 data center full of Nvidia B100’s || Energize a flux capacitor // Dr Brown conundrum. Yeah that data center wants continuous power. Hmmm.

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223918 Fri, 03 May 2024 14:15:36 +0000 https://www.nextplatform.com/?p=144092#comment-223918 In reply to John S.

This is a reasonable set of assumptions as far as I can see. Or, the hyper just goes on for three years….

]]>
By: John S https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223915 Fri, 03 May 2024 12:58:42 +0000 https://www.nextplatform.com/?p=144092#comment-223915 So when all this comes crashing down, which it will, we can expect GPU rental costs to fall by a factor of four right? Or even more? And those revenue numbers seem optimistic to me… who really needs this much GPU time for AI? Now for HPC and science… sure!

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223913 Fri, 03 May 2024 12:46:40 +0000 https://www.nextplatform.com/?p=144092#comment-223913 In reply to Eric Olson.

That’s part of it. But the fun bit is Nvidia has, at worst, something like 85 percent operating margins on its datacenter GPUs and then the cloud builders can still extract 65 percent to 70 percent operating margins on top of that by selling them as a service. Look at all that margin! And there are Taylor Swift effects driving this at both the Nvidia and the cloud levels for sure. If the competitors could get supply and make their devices so cheaply — there is a reason why the B100 is not very different packaging wise from the H100 and the H100 is not very different from the A100 really except some modest cranks — they would be putting competitive pressure on Nvidia. But the market is expanding so fast that Nvidia feels no pressure. Like Intel in CPUs in 2018 through 2020, even as AMD brought increasing heat. But since 2021, has Intel ever been feeling it.

]]>
By: Eric Olson https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223901 Fri, 03 May 2024 04:02:09 +0000 https://www.nextplatform.com/?p=144092#comment-223901 Since the supplies of GPUs are limited, could renting time be similar to buying scalped tickets to a Taylor Swift concert? I see two possible outcomes: GPUs rapidly become more available at lower cost; Swift forbids scalping tickets.

]]>
By: Dan Olds https://www.nextplatform.com/2024/05/02/how-to-make-more-money-renting-a-gpu-than-nvidia-makes-selling-it/#comment-223899 Fri, 03 May 2024 02:28:24 +0000 https://www.nextplatform.com/?p=144092#comment-223899 Extremely good analysis! I wish I had done it!

]]>