Comments on: Nvidia Will Be The Next IT Giant To Break $100 Billion In Sales https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Mon, 04 Mar 2024 15:31:32 +0000 hourly 1 https://wordpress.org/?v=6.5.5 By: UK https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220834 Tue, 27 Feb 2024 15:25:03 +0000 https://www.nextplatform.com/?p=143695#comment-220834 In reply to Timothy Prickett Morgan.

I wrote above that Nvidia needs some pressure as it is way too big.

After having read

https://www.theregister.com/2024/02/27/jensen_huang_coders/?td=rt-3a

I think there are no extra efforts necessary…

]]> By: Timothy Prickett Morgan https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220745 Sat, 24 Feb 2024 19:12:11 +0000 https://www.nextplatform.com/?p=143695#comment-220745 In reply to EC.

Let’s have some fun. Twice as many chips with twice as much memory each. Now, downshift to FP4? Goose the performance per Tensor Core by, oh, let’s be crazy, 50 percent on transformers by making in wider and deeper. That’s 2 * 1.75 * 2 * 1.5 = 10X. Yeah that sounds about right.

]]> By: EC https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220743 Sat, 24 Feb 2024 18:26:51 +0000 https://www.nextplatform.com/?p=143695#comment-220743 “The performance of Blackwell is off the charts. It’s going to be incredible” – Jensen Huang
https://www.wired.com/story/nvidia-hardware-is-eating-the-world-jensen-huang/

]]> By: UK https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220690 Fri, 23 Feb 2024 09:57:45 +0000 https://www.nextplatform.com/?p=143695#comment-220690 In reply to HuMo.

The problem, if their claims would be really true, would not be the TDP, as the H100 has up to 350W and the H200 up to 700W, which is, compared to the 950W of the Prodigy, which, according to their claims replaces several tens of them (52 in their examples) – so it would replace a bigger oven with a smaller one.
Well, it is just as Mr.Morgan said – the problem is, that until now there is no real chip.

]]> By: Adir Zevulun https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220656 Thu, 22 Feb 2024 17:54:59 +0000 https://www.nextplatform.com/?p=143695#comment-220656 New Yorker : https://www.newyorker.com/magazine/2023/12/04/how-jensen-huangs-nvidia-is-powering-the-ai-revolution
”
When CUDA was released, in late 2006, Wall Street reacted with dismay.
Ben Gilbert, the co-host of “Acquired,” a popular Silicon Valley podcast, said. “They were spending many billions targeting an obscure corner of academic and scientific computing, which was not a large market at the time—certainly less than the billions they were pouring in.”
In marketing CUDA, Nvidia had sought a range of customers, including stock traders, oil prospectors, and molecular biologists. .. One application that Nvidia spent little time thinking about was artificial intelligence. There didn’t seem to be much of a market.
“

]]> By: HuMo https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220646 Thu, 22 Feb 2024 14:14:42 +0000 https://www.nextplatform.com/?p=143695#comment-220646 In reply to Timothy Prickett Morgan.

Well, if I had $7 trillion to spend … I too would buy a 13.67 AI-ZettaFlop/s Prodigy 2 baking factory … to be located in Asheville NC, next to the Vallée de la Loire Biltmore Estate Castle, right down the road from a world-famous studio-garage! (eh-eh-eh!)

(as featured on French News last week: https://www.francetvinfo.fr/monde/usa/etats-unis-le-domaine-de-biltmore-le-plus-francais-des-chateaux-d-amerique_6367741.html )

]]> By: Timothy Prickett Morgan https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220644 Thu, 22 Feb 2024 13:23:51 +0000 https://www.nextplatform.com/?p=143695#comment-220644 In reply to UK.

We all highly doubt Tachyum. Show me a real chip, show me a real system running real software and we will be thrilled to write about it.

]]> By: UK https://www.nextplatform.com/2024/02/22/nvidia-will-be-the-next-it-giant-to-break-100-billion-in-sales/#comment-220639 Thu, 22 Feb 2024 09:35:06 +0000 https://www.nextplatform.com/?p=143695#comment-220639 I think it was really wise to block the Nvidia-ARM deal and hopefully Tachyum can fulfill their claims:

“Prodigy’s
powerful AI capabilities enable LLMs to run much easier and cost-effectively than existing CPU + GPGPU
based systems. A single 96-core Prodigy with 1 TB of memory can run a ChatGPT4 model with 1.7 trillion
parameters, whereas it requires 52 Nvidia H100 GPUs to run the same thing at significantly higher cost and
power consumption.
Prodigy ATX Platform
allows access to
cutting-edge AI models
for as low as $5,000
This paper presents the Prodigy ATX Platform, focusing on the hardware architecture, target applications,
and how it will democratize AI for those who wouldn’t normally have access to sophisticated AI models. The
Prodigy ATX Platform allows everyone to run cutting edge AI models for as low as $5,000 in an entry-level
platform SKU configuration featuring a 48-core Prodigy and 256 GB of DDR5 memory.”
->Tachyum in their paper “Tachyum’s Prodigy
ATX Platform
Democratizing AI for Everyone”

“A single Prodigy using
TAI with 2-bit weights
replaces 52 Nvidia H200
GPGPUs for Switch
Transformer LLM with
1.6 trillion parameters”
->Tachyum in their paper “Tachyum Prodigy Universal Processor
Enabling 50 EF / 8 AI ZF
Supercomputers in 2025”

Nvidia in my opinion is way too dominant and and needs some pressure, also to do more on the OpenSource front regarding drivers.

]]>