[Meatloaf] Sleezon's 100K AI Cluster

Jeff Hayas jeff.hayas at gmail.com
Sat Nov 2 18:05:40 MDT 2024


Wow.  At 28K$ (retail) per GPU
<https://www.amazon.com/NVIDIA-Hopper-Graphics-5120-Bit-Learning/dp/B0CXBNNNSD>,
that's 280M$ just for the GPU's.
Then there is the cost of Racks, Power and Cooling systems, and of course
the data-interconnects (I wonder what architecture they use);
for all that we can probably say the cost is 10X the GPU's.  So yeah, $2-3
Billion(US).

I find it ironic that they chose to call the Super-AI system "Colossus", as
in the 1970 film "Colossus: The Forbin Project"
<https://en.wikipedia.org/wiki/Colossus:_The_Forbin_Project>.
We'll know we're in trouble if the new Colossus system has Musk
assassinated.

-- Uncle Ersatz


On Fri, 1 Nov 2024 at 17:50, pt <mnemotronic at gmail.com> wrote:

> Official Joe's Spoon Reflector.
>
> All your base are belong to us. You are on the way to destruction.
> You have no chance to survive make your time. HA HA HA HA...
> For great justice.
>
> For those who have heard stories of Elon Musk’s xAI building a giant AI
> supercomputer in Memphis, this is that cluster. With 100,000 NVIDIA H100
> GPUs, this multi-billion-dollar AI cluster is notable not just for its size
> but also for the speed at which it was built. In only 122 days, the teams
> built this giant cluster.
>
>
> https://www.servethehome.com/inside-100000-nvidia-gpu-xai-colossus-cluster-supermicro-helped-build-for-elon-musk/
>
>
> --
> Please wash your hands and change your shoes after shredding this message
> into tiny bits and trampling it into the ground.
> --
> Meatloaf mailing list
> Meatloaf at dashs.denver.co.us
> http://dashs.denver.co.us:7083/cgi-bin/mailman/listinfo meatloaf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://dashs.denver.co.us:7083/pipermail/meatloaf/attachments/20241102/48abf72d/attachment.htm>


More information about the Meatloaf mailing list