Compute
The First AI Benchmarks Pitting AMD Against Nvidia
Rated horsepower for a compute engine is an interesting intellectual exercise, but it is where the rubber hits the road that really matters. …
inference
AI
Stacking Up Intel Gaudi Against Nvidia GPUs For AI
Updated: Here is something we don’t see much anymore when it comes to AI systems: list prices for the accelerators and the base motherboards that glue a bunch of them together into a shared compute complex. …
AI
Talking AI Costs And Addressable Markets With SambaNova
The only way to accurately predict the future is to live it, but just the same, prognostication is one of the things that we humans love to do. …
AI
How AWS Can Undercut Nvidia With Homegrown AI Compute Engines
Amazon Web Services may not be the first of the hyperscalers and cloud builders to create its own custom compute engines, but it has been hot on the heels of Google, which started using its homegrown TPU accelerators for AI workloads in 2015. …
AI
Groq Says It Can Deploy 1 Million AI Inference Chips In Two Years
If you are looking for an alternative to Nvidia GPUs for AI inference – and who isn’t these days with generative AI being the hottest thing since a volcanic eruption – then you might want to give Groq a call. …
AI
Big Blue Can Still Catch The AI Wave If It Hurries
It has been two and a half decades since we have seen a rapidly expanding universe of a new kind of compute that rivals the current generative AI boom. …
AI
Optimizing AI Inference Is As Vital As Building AI Training Beasts
The history of computing teaches us that software always and necessarily lags hardware, and unfortunately that lag can stretch for many years when it comes to wringing the best performance out of iron by tweaking algorithms. …
AI
Chiplet Cloud Can Bring The Cost Of LLMs Way Down
If Nvidia and AMD are licking their lips thinking about all of the GPUs they can sell to the hyperscalers and cloud builders to support their huge aspirations in generative AI – particularly when it comes to the OpenAI GPT large language model that is the centerpiece of all of the company’s future software and services – they had better think again. …
AI
Meta Platforms Crafts Homegrown AI Inference Chip, AI Training Next
As we pointed out a year ago when some key silicon experts were hired from Intel and Broadcom to come work for Meta Platforms, the company formerly known as Facebook was always the most obvious place to do custom silicon. …
AI
A Peek Into The Future Of AI Inference At Nvidia
The best kinds of research are those that test new ideas and that also lead to practical innovations in real products. …