Inside the World's Largest AI Supercluster xAI Colossus

ServeTheHome October 28, 2024
Video Thumbnail
ServeTheHome Logo

ServeTheHome

@servethehomevideo

About

The official ServeTheHome.com YouTube channel. From time to time we will have videos that are part of our reviews posted here.

Video Description

We FINALLY get to show the largest AI supercomputer in the world, xAI Colossus. This is the 100,000 (at the time we filmed this) GPU cluster in Memphis Tennessee that has been on the news a lot. This video has been five months in the making, and finally Elon Musk gave us the green light to not just film, but also show everyone the Supermicro side of the cluster. This video is being sponsored by Supermicro and that is why we are only showing the Supermicro side, which is the more advanced side. Unlike our normal content creation, this video had to be reviewed by Elon and his team before going live and we were asked to blur out portions at their request. STH Main Site Article: https://www.servethehome.com/inside-100000-nvidia-gpu-xai-colossus-cluster-supermicro-helped-build-for-elon-musk/ Join Our Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Related Supermicro Sponsored Content Mentioned in this Video ---------------------------------------------------------------------- https://www.supermicro.com/ai https://www.supermicro.com/ai-supercluster ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 01:44 Inside a xAI Colossus Data Hall 02:22 Supermicro Liquid Cooled GPU Racks 08:30 Supermicro Compute and Storage Racks 08:54 Networking is Awesome 11:51 Supermicro Storage Servers 12:26 Data Center Liquid Cooling 13:33 Tesla Megapacks for Power 14:08 Future Expansion and Thank Yous

Build Your AI Supercluster Today

AI-recommended products based on this video

Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

(1,607)
$419.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

(9)
$3,950.00$3,752.50
FREE delivery Wed, Jun 18
Loading...
Gamdias PCIe 5.1 & ATX3.1 Gold 1000W Power Supply for GeForce RTX 5000 Series, 1000W Fully Modular ATX 80 Plus Gold Computer PSU for Gaming PC Desktops, Low-Noise Fan, Helios P2-1000G

Gamdias PCIe 5.1 & ATX3.1 Gold 1000W Power Supply for GeForce RTX 5000 Series, 1000W Fully Modular ATX 80 Plus Gold Computer PSU for Gaming PC Desktops, Low-Noise Fan, Helios P2-1000G

(9)
$159.99
FREE delivery Wed, Oct 8
Loading...
INIU USB C Charger Block, 100W 3-Port PD Fast Charging, Advanced GaN Power Adapter, Foldable Charger with USB C Cable for MacBook Air 13 Pro, iPad, iPhone 17 16 Pro Max, Samsung S25 S24, Switch 2 etc ClimatePartner certified

INIU USB C Charger Block, 100W 3-Port PD Fast Charging, Advanced GaN Power Adapter, Foldable Charger with USB C Cable for MacBook Air 13 Pro, iPad, iPhone 17 16 Pro Max, Samsung S25 S24, Switch 2 etc ClimatePartner certified

(795)
$36.99$34.40
FREE delivery Mon, Feb 9
500+ bought in past month
Loading...
Wireless CarPlay Adapter for Apple iPhone - Upgrade Wired CarPlay to Wireless Device, Mini T-Shaped for Car USB Plug and Play Auto Reconnect, for Vehicle GPS Navigation Car Stereo Receivers, Black

Wireless CarPlay Adapter for Apple iPhone - Upgrade Wired CarPlay to Wireless Device, Mini T-Shaped for Car USB Plug and Play Auto Reconnect, for Vehicle GPS Navigation Car Stereo Receivers, Black

(72)
$39.47
FREE delivery Mon, Feb 9
300+ bought in past month
Loading...
CarPlay Wireless Adapter, Stable Fast Mini Carplay Wireless Adapter, Plug and Play, Stable Car Control & No Delay,Mini Edition,Equipped with Bluetooth 5.3 and Dual-Band WiFi 0001

CarPlay Wireless Adapter, Stable Fast Mini Carplay Wireless Adapter, Plug and Play, Stable Car Control & No Delay,Mini Edition,Equipped with Bluetooth 5.3 and Dual-Band WiFi 0001

(11,830)
$33.26
FREE delivery Mon, Feb 2 on your first order
Loading...
Asus TUF Gaming GeForce RTX ™ 5070 Ti 16GB GDDR7 BTF White OC Edition Gaming Graphics Card (PCIe® 5.0, HDMI®/DP 2.1, 3.125-slot, Military-Grade Components, with a Detachable GC-HPWR Adapter)

Asus TUF Gaming GeForce RTX ™ 5070 Ti 16GB GDDR7 BTF White OC Edition Gaming Graphics Card (PCIe® 5.0, HDMI®/DP 2.1, 3.125-slot, Military-Grade Components, with a Detachable GC-HPWR Adapter)

(968)
$1,206.99
FREE delivery Wed, Jan 7
100+ bought in past month