Comments on: Celestial AI Wants To Break The Memory Wall, Fuse HBM With DDR5 https://www.nextplatform.com/2024/04/04/celestial-ai-wants-to-break-the-memory-wall-fuse-hbm-with-ddr5/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Thu, 11 Apr 2024 12:44:33 +0000 hourly 1 https://wordpress.org/?v=6.5.5 By: Rain https://www.nextplatform.com/2024/04/04/celestial-ai-wants-to-break-the-memory-wall-fuse-hbm-with-ddr5/#comment-222999 Wed, 10 Apr 2024 16:23:46 +0000 https://www.nextplatform.com/?p=143913#comment-222999 In reply to Anonymouse.

THIS

]]>
By: Anonymouse https://www.nextplatform.com/2024/04/04/celestial-ai-wants-to-break-the-memory-wall-fuse-hbm-with-ddr5/#comment-222952 Tue, 09 Apr 2024 15:33:10 +0000 https://www.nextplatform.com/?p=143913#comment-222952 1.8GB/Sec? Off by a few orders of magnitude?

]]>
By: Calamity Jim https://www.nextplatform.com/2024/04/04/celestial-ai-wants-to-break-the-memory-wall-fuse-hbm-with-ddr5/#comment-222764 Fri, 05 Apr 2024 08:41:24 +0000 https://www.nextplatform.com/?p=143913#comment-222764 Great to see competition heating up in this space of on-chip interconnects, here with mixed memory (HBM+DDR), and more generally in C2C/D2D scenarios, especially through CPO (which Nvidia considered too expensive and power-hungry for NVL72 at this time — and so, competitive dynamics is working to fix this as we speak!). With transparent HALs, these techs (from Ayar, Celestial, Eliyan, Lightmatter, …) will be key to seamlessly composing powerful choreographies of heterogeneous and distributed HPC/AI/ML systems IMHO, from fiber shuffle to cupid shuffle, through cha-cha-slide, and full-tilt boot-scoot boogie (eh-eh-eh!). Nvidia, MS/OpenAI (Stargate), ORNL (Discovery successor to Frontier), and EU-HPC all seem to be leaning this way, for their next computational efforts.

A great job by Celestial here!

]]>