Running LLM Clusters on ALL THIS ๐
Alex Ziskind
View ChannelAbout
Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโm Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐ https://www.youtube.com/@azisk?sub_confirmation=1
Latest Posts
Video Description
I test the cluster workflow on MacBook Pro and MacBook Airs, all sharing LLM models via an all-SSD NAS, while talking to each other via Thunderbolt. ๐ Gear Links ๐ * ๐๐ฅ All SSD NAS: https://amzn.to/3YCTr9R * ๐ป๐ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * ๐ป๐ MacBook Air M2 Deal: https://amzn.to/3Ay78PC * ๐ ๏ธ๐ MacBook Air M3: https://amzn.to/4fz8Hvq * ๐งโก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * ๐ ๏ธ๐ My nvme ssd: https://amzn.to/3YLEySo * ๐ฆ๐ฎ My gear: https://www.amazon.com/shop/alexziskind ๐ฅ Related Videos ๐ฅ * ๐ค REALITY vs Appleโs Memory Claims - https://youtu.be/fdvzQAWXU7A * ๐ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * ๐ ๏ธ Set up Conda - https://youtu.be/2Acht_5_HTo * ๐ค INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐ ๏ธ Conda setup for Python dev - https://youtu.be/2Acht_5_HTo * ๐ ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐ AI for Coding Playlist: ๐ - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw Exo project: https://github.com/exo-explore/exo โ โ โ โ โ โ โ โ โ โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ โ โ โ โ โ โ โ โ Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ โ โ โ โ โ โ โ โ ๐ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment
Boost Your LLM Setup Today
AI-recommended products based on this video

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

GIGABYTE - AORUS Elite 16 Gaming Laptop - 165Hz 2560x1600 WQXGA - NVIDIA GeForce RTX 5070 - Intel Core Ultra 9 275HX - 1TB SSD with 32GB DDR5 RAM - Windows 11 Home AD (AORUS Elite 16 BWHC3USC64SH)

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

Dell Inspiron 3535 Laptop - 15.6 inch FHD (1920 x 1080) 120Hz Display, AMD Ryzen 5-7520U Processor, 8GB LPDDR5 RAM, 512GB SSD, AMD Radeon Graphics, Windows 11 Home, Migrate Service - Carbon Black EPEAT

MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G

HP 17.3" FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card

AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)
![SAMSUNG 870 EVO SATA SSD 500GB 2.5โ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]](https://m.media-amazon.com/images/I/911ujeCkGfL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA SSD 500GB 2.5โ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]
![SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]](https://m.media-amazon.com/images/I/71W2nK7LUrL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]
![SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]](https://m.media-amazon.com/images/I/71lzXt4djxL._AC_UY654_FMwebp_QL65_.jpg)
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

be quiet! Dark Power Pro 13 1300W Power Supply | ATX 3.1 Compliant | 80 Plus Titanium | Digital Regulation for PCIe 5.0 and PCIe 6+2 Graphics Cards, | 2X 12VHPWR Cable Included | BN500

VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC







































