Running LLM Clusters on ALL THIS ๐Ÿš€

Alex Ziskind โ€ข December 18, 2024
Video Thumbnail
Alex Ziskind Logo

Alex Ziskind

View Channel

About

Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโ€™m Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐Ÿš€ https://www.youtube.com/@azisk?sub_confirmation=1

Video Description

I test the cluster workflow on MacBook Pro and MacBook Airs, all sharing LLM models via an all-SSD NAS, while talking to each other via Thunderbolt. ๐Ÿ›’ Gear Links ๐Ÿ›’ * ๐Ÿ๐Ÿ’ฅ All SSD NAS: https://amzn.to/3YCTr9R * ๐Ÿ’ป๐Ÿ”„ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * ๐Ÿ’ป๐Ÿ”„ MacBook Air M2 Deal: https://amzn.to/3Ay78PC * ๐Ÿ› ๏ธ๐Ÿš€ MacBook Air M3: https://amzn.to/4fz8Hvq * ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo * ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ * ๐Ÿค– REALITY vs Appleโ€™s Memory Claims - https://youtu.be/fdvzQAWXU7A * ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐Ÿ› ๏ธ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * ๐Ÿ› ๏ธ Set up Conda - https://youtu.be/2Acht_5_HTo * ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐Ÿ› ๏ธ Conda setup for Python dev - https://youtu.be/2Acht_5_HTo * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw Exo project: https://github.com/exo-explore/exo โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment

You May Also Like

Boost Your LLM Setup Today

AI-recommended products based on this video

Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

(283)
$1,658.99
Loading...
GIGABYTE - AORUS Elite 16 Gaming Laptop - 165Hz 2560x1600 WQXGA - NVIDIA GeForce RTX 5070 - Intel Core Ultra 9 275HX - 1TB SSD with 32GB DDR5 RAM - Windows 11 Home AD (AORUS Elite 16 BWHC3USC64SH)

GIGABYTE - AORUS Elite 16 Gaming Laptop - 165Hz 2560x1600 WQXGA - NVIDIA GeForce RTX 5070 - Intel Core Ultra 9 275HX - 1TB SSD with 32GB DDR5 RAM - Windows 11 Home AD (AORUS Elite 16 BWHC3USC64SH)

(0)
$9,050.69
FREE delivery Aug 28 - Sep 8Only 3 left in stock.
Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
Dell Inspiron 3535 Laptop - 15.6 inch FHD (1920 x 1080) 120Hz Display, AMD Ryzen 5-7520U Processor, 8GB LPDDR5 RAM, 512GB SSD, AMD Radeon Graphics, Windows 11 Home, Migrate Service - Carbon Black EPEAT

Dell Inspiron 3535 Laptop - 15.6 inch FHD (1920 x 1080) 120Hz Display, AMD Ryzen 5-7520U Processor, 8GB LPDDR5 RAM, 512GB SSD, AMD Radeon Graphics, Windows 11 Home, Migrate Service - Carbon Black EPEAT

(449)
$649.99
FREE delivery Sun, Aug 24
50+ bought in past month
Loading...
MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G

MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G

(521)
$1,389.99
FREE delivery Sun, Aug 10
Loading...
HP 17.3" FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card

HP 17.3" FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card

(13)
$899.00
FREE delivery Wed, Jun 18
Loading...
AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

(14)
$1,999.90
Loading...
Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W

Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W

(949)
$459.95
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

(12,472)
$19.99$18.59
FREE delivery Sun, Aug 10 on your first order
400+ bought in past month
Loading...
be quiet! Dark Power Pro 13 1300W Power Supply | ATX 3.1 Compliant | 80 Plus Titanium | Digital Regulation for PCIe 5.0 and PCIe 6+2 Graphics Cards, | 2X 12VHPWR Cable Included | BN500

be quiet! Dark Power Pro 13 1300W Power Supply | ATX 3.1 Compliant | 80 Plus Titanium | Digital Regulation for PCIe 5.0 and PCIe 6+2 Graphics Cards, | 2X 12VHPWR Cable Included | BN500

(124)
$489.99
FREE delivery Wed, Oct 8
Loading...
VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC

VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC

(15)
$423.43$369.00
Prime$11.85 delivery Thu, Jun 26
Loading...
Asus ROG Strix 1000W Gold Aura Edition (Fully Modular Power Supply, 80+ Gold Certified, ATX 3.0, Cybenetics Lambda A+ Certification, PCIe Gen 5.0 Ready, Axial-tech Fan, Aura Sync, 10-Year Warranty)

Asus ROG Strix 1000W Gold Aura Edition (Fully Modular Power Supply, 80+ Gold Certified, ATX 3.0, Cybenetics Lambda A+ Certification, PCIe Gen 5.0 Ready, Axial-tech Fan, Aura Sync, 10-Year Warranty)

(38)
$267.83$262.70
FREE delivery Oct 9 - 10