Comments on: OpenAI To Join The Custom AI Chip Club? https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Tue, 24 Oct 2023 16:30:10 +0000 hourly 1 https://wordpress.org/?v=6.5.5 By: E https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-215084 Mon, 16 Oct 2023 21:35:44 +0000 https://www.nextplatform.com/?p=143098#comment-215084 I think you might need to add a zero to your custom ASIC cost estimate… The article you cited is almost a decade old now and maxes out at a pretty old technology node. Just the mask costs for a 4nm ASIC (similar to what Tenstorrent is targeting in their partnership with Samsung: https://www.prnewswire.com/news-releases/tenstorrent-selects-samsung-foundry-to-manufacture-next-generation-ai-chiplet-301943705.html) will be close to your low end number. Chip Architecture, Design and Verification costs, IP Costs for SerDes and standard SoC interface IP (e.g. PCIe, HBM/(LP)DDR), and SoC infrastructure, P&R costs, firmware, software… eek! That adds up to hundreds of millions of dollars even for “modest” ASICs in advanced nodes these days… Otherwise, great article!

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214940 Fri, 13 Oct 2023 11:01:12 +0000 https://www.nextplatform.com/?p=143098#comment-214940 In reply to Slim Jim.

hahahahahahaha

]]>
By: Slim Jim https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214928 Fri, 13 Oct 2023 01:32:45 +0000 https://www.nextplatform.com/?p=143098#comment-214928 Maybe they should buy Tachyum?

]]>
By: François Lechat https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214795 Tue, 10 Oct 2023 03:22:50 +0000 https://www.nextplatform.com/?p=143098#comment-214795 In reply to Timothy Prickett Morgan.

Like we French HPC always say, unless giddily rush the weapon, there is nothing to fear … but AI/ML processed cheese itself (and logarithms!)! It is old Franklin proverb: fear not, want not. (hé-hé-hé!)

]]>
By: HuMo https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214791 Tue, 10 Oct 2023 01:53:56 +0000 https://www.nextplatform.com/?p=143098#comment-214791 In reply to Timothy Prickett Morgan.

Maybe that 2x part of life, also known as lifefefe? 8^b

]]>
By: amanfromMars 1 https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214777 Mon, 09 Oct 2023 16:51:11 +0000 https://www.nextplatform.com/?p=143098#comment-214777 In reply to Timothy Prickett Morgan.

“Can any part of life be larger than life?” one asks.

Well Yes, of course, …… they be all of those parts self-actuated to practically remotely realise with physical abandon, virtualisable phorms, absolutely fabulous dreams and rogue renegade nightmares in reciprocal agreement with both Einstein and Rushian thoughts, and without the worryisome fear of unwarranted doubt forbidding and preventing total information awareness access providing ITs AWEsome Utility for Enhancing Abilities …… “I am enough of an artist to draw freely upon my imagination. Imagination is more important than knowledge. Knowledge is limited. Imagination encircles the world, and all there ever will be to know and understand” …… “And the knowledge that they fear is a weapon to be used against them …. And the things that he fears are a weapon to be held against him”

And the future really holds no fears for masters and mistresses of ultimate weapons with almighty arsenals of smart ammunition and even smarter intelligence leads and feeds.

🙂 Naturally though, will many a soul imagine all of that to be completely wrong …. and miss out catastrophically on all of the available fun. That be their great loss, Timothy Prickett Morgan. And of that there is no shadow of doubt.

]]>
By: Timothy Prickett Morgan https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214772 Mon, 09 Oct 2023 12:20:45 +0000 https://www.nextplatform.com/?p=143098#comment-214772 In reply to amanfromMars 1.

“Can any part of life be larger than life?”

]]>
By: amanfromMars 1 https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214760 Mon, 09 Oct 2023 02:07:31 +0000 https://www.nextplatform.com/?p=143098#comment-214760 Given the very clear almighty advantage that successful development of novel AI processed, processing chippery would/could effortless unilaterally deliver, ….. and for the very good, prime directive reason of ensuring present and future guaranteed maintenance and failsafe stealthy secret COSMIC* national and international and internetional security facility and utility, ….. that first sentence most definitely would be better revised to ask such a question as ….. “Should it be next to impossibly hard to find something that is growing faster than the Nvidia datacenter business?” ……. with even that question being further revised to accommodate/mitigate very possible, and therefore highly probable, existential threat exploit vulnerabilities/features, ……. “Can it be made next to impossible for IT and AI to find everything and anything growing faster than themselves.” ……. with the answer to both of those questions best being accurately realised and accepted as Yes and No.

COSMIC* .. Control Of Secret Materiel in an Internetional Command

]]>
By: HuMo https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214717 Sat, 07 Oct 2023 19:19:57 +0000 https://www.nextplatform.com/?p=143098#comment-214717 In reply to Slim Albert.

Right smack on! As long as you’re not looking to dual-purposing with HPC, your AI log-space in-memory chippery can deal with just 4-bit signed integers (approx 1e-2 to 1e2 dynamic range in log2) or 8-bit if pushing it (1e-38 to 1e38 maximum overkill). Biological signaling has neither negative nor perfect zero values in the living brain, making the rhythm of logarithms a logical algorithm (many thanks to Al-Khwârizmî, Napier, Boole, and Jimi Hendrix!)!

Interconnect complexity, to represent the synaptic connectome, should be the critical component here. Apart from that, just evenly sprinkle 4-bit adders and max units, like peperroni, in a bed of shredded SRAM or SDRAM cheeses, atop that tasty interconnect secret sauce, and presto: a most satisfying, and inexpensive, AI dataflow pizza, right in time for the weekend! For a more chunky texture, pack the 4-bit add/max units into vector meatballs, combine with chunks of HBM or DDR5, spread over a lighter interconnect sauce, and voila!

Quite obliviously, none of these 4-bit cookbook log recipe shenanigans will do much to solve HPC’s memory-wall sticky spaghetti problem, nor the bedbugpocalypse rampaging through Paris and points South (looking at you, Bruyères-le-Châtel!) as we speak. For those, we need some real cauliflower! b^8

]]>
By: Paul Aquino https://www.nextplatform.com/2023/10/06/openai-to-join-the-custom-ai-chip-club/#comment-214711 Sat, 07 Oct 2023 12:06:28 +0000 https://www.nextplatform.com/?p=143098#comment-214711 “It would hard to find something that is growing faster than the Nvidia”…,

There is one minor grammatical error in the first sentence.

It should be,” It would be hard to find something”…,

Your analysis is impressive.

]]>