万卡集群的AI数据中心,到底是如何运作的?

硅谷101 October 31, 2024
Video Thumbnail
硅谷101 Logo

硅谷101

@thevalley101

About

驶向未来。 一档深度科技与商业视频栏目,旗下有同名播客。通过对前沿科技及商业的一手视角和深度挖掘,我们希望带来深度有趣的前沿选题。Solid journalism still matters. 联系我们:[email protected]

Video Description

在AI训练集群日益强大的背后,隐藏着一群不为人知的“兵部尚书”,它们就是数据中心的基础设施。随着AI模型对算力需求的激增,“兵部尚书”也面临前所未有的挑战:功率密度飙升、水资源消耗巨大、电能供应捉襟见肘、部署速度要求紧迫,那么问题来了,为什么数据中心会如此耗水?电力系统如何制约了数据中心的升级?为了快速部署,数据中心也走向了“预制化”建设,甚至用木材替代钢筋水泥,真的行得通吗?这期视频我们邀请了维谛技术的多位专家,一起来解析AI爆发给数据中心的基础设施带来的挑战与机遇。 时间轴: 00:00 - 04:04 数据中心基础设施的挑战与机遇 04:05 - 07:49 冷却系统的重要性与原理 07:50 - 10:34 数据中心为何如此耗水? 10:35 - 15:13 冷却系统的经济账 15:14 - 16:22 数据中心升级瓶颈在哪? 16:23 - 18:48 供电系统面临的挑战 18:49 - 20:49 设备一体化与效率提升 20:50 - 25:20 数据中心走向了“预制化”的道路 【关于硅谷101】 我们是由海内外一线媒体记者/主持人创办的栏目,深度解析硅谷创新趋势,以轻松的风格分享科技行业的最新动态。我们采过顶级科技大佬,积累了数万小时的媒体经验,做过调查性报道,操盘过千万级传播量的知名深度稿,引发全国讨论和微博热搜;致力于将最专业的媒体素养和信息搜集能力转化为易传播的新媒体力量。 旗下同名播客栏目:https://www.youtube.com/@valley101podcast 关注我们,从这里驶向未来。 联系我们:[email protected] 【往期精彩视频】 增长、AI以及领导力:专访Airbnb联合创始人兼CEO Brian Chesky https://www.youtube.com/watch?v=csHt6O6Tc-w&t=1752s 自动驾驶(上):”端到端“AI新春天依然分裂、冲突、孤注一掷 https://www.youtube.com/watch?v=Jy5OozI1zMs 自动驾驶(下):千亿美元的喧嚣与寒冬后,无人驾驶终于要落地了? https://www.youtube.com/watch?v=58bS_-215vI&t=137s 谎言、打压、逐利与权力游戏,波音是如何失去制造骄傲的? https://www.youtube.com/watch?v=PSfdilqMxRM&t=875s 【深度】世纪骗局落幕:“加密货币之王”SBF的疯狂人生与FTX帝国的崩塌 https://www.youtube.com/watch?v=LyCv2Dm9A1o&t=1725s 抢电、圈地、对赌,深聊科技巨头的千亿美元AI能源大战 https://www.youtube.com/watch?v=6vNxFPRdrgs&t=101s 平庸且保守,但苹果或是AI落地的最大赢家|深度解读WWDC 2024 https://www.youtube.com/watch?v=oERpVnnl0NQ&t=29s 揭秘硅谷疯狂“抢人”内幕 :AI精英人均“百万美元”薪酬,业界标配还是谣言? https://www.youtube.com/watch?v=5Dw1ZtBKoc0&t=1317s “loser文化”到“AI数据金矿”:美国贴吧Reddit的19年爱恨史,及它的新资本故事 https://www.youtube.com/watch?v=H9-wmvlW8QI 【硬核】在诉讼与骂名中崛起的英伟达GPU:从未停止过战斗,也没有永远的朋友 https://www.youtube.com/watch?v=UBwHVneGiXs&t=194s 从Sora展开,全面解读AI视频大模型发展史 https://www.youtube.com/watch?v=oWO80lkP4bs&t=1412s 各方大佬 “大打出手”:Sora是万众期待的“世界模型”吗? https://www.youtube.com/watch?v=YCH8yIxmPqc “全球市值第三车企”VinFast:越南首富的美国梦,惊叹和荣耀只有16个交易日 https://www.youtube.com/watch?v=-D8_AbbcT8Y OpenAI与谷歌多模态重磅更新,生成式AI大战升级第二轮|GPT-4o、Gemini、Project Astra https://www.youtube.com/watch?v=JaQmSHzjlpY 为马斯克减重30磅的“司美格鲁肽”:毒蜥蜴,琵琶鱼,41年和数十亿美元 https://www.youtube.com/watch?v=CfoF4HBFkKw&t=4s 【独家专访】诺奖得主Katalin Karikó:被威胁、冷落和打压40年后,那位“mRNA疯女人”拯救了数亿生命 https://www.youtube.com/watch?v=30BuA94F9pQ&t=363s

You May Also Like

Build Your AI Data Center Now

AI-recommended products based on this video

Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

(1,607)
$419.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
TP-Link 5 Port Gigabit Ethernet Network Switch (TL-SG1005D) - Plug and Play, Desktop or Wall Mount, Plastic Case, Ethernet Splitter, Fanless, Traffic Optimization, Unmanaged (TL-SG1005D)

TP-Link 5 Port Gigabit Ethernet Network Switch (TL-SG1005D) - Plug and Play, Desktop or Wall Mount, Plastic Case, Ethernet Splitter, Fanless, Traffic Optimization, Unmanaged (TL-SG1005D)

(21,445)
$14.99$13.49
FREE delivery Thu, Sep 4 on your first order
100+ bought in past month
Loading...
VASAGLE Bakers Rack with Power Outlet, Microwave Stand, Kitchen Tall Utility Storage Shelf, with Metal Wire Panel, 14 Hooks, 40 x 80 x 170 cm, Rustic Brown and Black UKKS025B01

VASAGLE Bakers Rack with Power Outlet, Microwave Stand, Kitchen Tall Utility Storage Shelf, with Metal Wire Panel, 14 Hooks, 40 x 80 x 170 cm, Rustic Brown and Black UKKS025B01

(1,303)
$134.99
FREE delivery Jun 20 - 30
50+ bought in past month
Loading...
Gold Dish Drying Rack with Drain Bins, Multifunctional Sink Caddy, Space-Saving Kitchen Organizer for Plates, Bowls, Utensils – Easy Assembly, Fast Drying, Portable (23.5 x 11 x 6 cm)

Gold Dish Drying Rack with Drain Bins, Multifunctional Sink Caddy, Space-Saving Kitchen Organizer for Plates, Bowls, Utensils – Easy Assembly, Fast Drying, Portable (23.5 x 11 x 6 cm)

(0)
$67.11
FREE delivery Aug 27 - Sep 18
Loading...
VASAGLE Entryway Coat Rack with Shoe Bench, Shoe Rack with Hall Tree, Rustic Brown and Black UHSR41BX

VASAGLE Entryway Coat Rack with Shoe Bench, Shoe Rack with Hall Tree, Rustic Brown and Black UHSR41BX

(6,076)
$66.99
FREE delivery Mon, Jun 16
100+ bought in past month
Loading...
VASAGLE Ladder Shelf, 4-Tier Bookshelf, Storage Rack, Bookcase with Steel Frame, for Living Room, Home Office, Kitchen, Bedroom, Industrial Style, Rustic Brown and Matte Black ULLS144B01

VASAGLE Ladder Shelf, 4-Tier Bookshelf, Storage Rack, Bookcase with Steel Frame, for Living Room, Home Office, Kitchen, Bedroom, Industrial Style, Rustic Brown and Matte Black ULLS144B01

(15,729)
$95.19
Loading...
HEYSTOP Switch 2 Case Compatible with Nintendo Switch 2, Switch 2 Accessories with 10 Game Cartridges Protective Hard Shell Travel Bag Pouch for Nintendo Switch 2 Console and Accessories, Black

HEYSTOP Switch 2 Case Compatible with Nintendo Switch 2, Switch 2 Accessories with 10 Game Cartridges Protective Hard Shell Travel Bag Pouch for Nintendo Switch 2 Console and Accessories, Black

(90)
$27.99
FREE delivery Tue, Jun 17 on your first order
Loading...
HEYSTOP Switch 2 Case for Nintendo Switch 2, Protective Case Compatible with Nintendo Switch 2, Switch 2 Accessories Kit with Grip Controller ,Tempered Glass Screen Protector, Thumb Stick Caps

HEYSTOP Switch 2 Case for Nintendo Switch 2, Protective Case Compatible with Nintendo Switch 2, Switch 2 Accessories Kit with Grip Controller ,Tempered Glass Screen Protector, Thumb Stick Caps

(60)
$23.99
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month
Loading...
HEYSTOP Switch 2 Case for Nintendo Switch 2, TPU Switch 2 Case for Nintendo Switch 2, Nintendo Switch 2 Accessories for Nintendo Switch 2 with Hollow Design

HEYSTOP Switch 2 Case for Nintendo Switch 2, TPU Switch 2 Case for Nintendo Switch 2, Nintendo Switch 2 Accessories for Nintendo Switch 2 with Hollow Design

(22)
$23.99
FREE delivery Sun, Jun 15 on your first order
Loading...
HEYSTOP Switch Case/Switch OLED Case Compatible Nintendo Switch & 2021 OLED Model Switch Protective Hard Portable Travel Carry Case Shell Pouch Compatible with Nintendo Switch Console and Accessories

HEYSTOP Switch Case/Switch OLED Case Compatible Nintendo Switch & 2021 OLED Model Switch Protective Hard Portable Travel Carry Case Shell Pouch Compatible with Nintendo Switch Console and Accessories

(7,809)
$13.99
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month