Using Clusters to Boost LLMs 🚀

Video Description

I test the cluster workflow that allowed Alex to run Llama 405B model on 2 laptops! Check out DevStarterPack here: https://devstarterpack.io 🛒 Gear Links 🛒 * 🍏💥 K9 Mini with 32GB RAM: https://amzn.to/3ZiKjcp * 🛠️🚀 96GB RAM kit: https://amzn.to/3ZhQ4qR * 💻🔄 Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo * 📦🎮 My gear: https://www.amazon.com/shop/alexziskind 🎥 Related Videos 🎥 * 🤖 REALITY vs Apple’s Memory Claims - https://youtu.be/fdvzQAWXU7A * 🌗 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * 🛠️ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * 🛠️ Set up Conda - https://youtu.be/2Acht_5_HTo * 🤖 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * 🛠️ Conda setup for Python dev - https://youtu.be/2Acht_5_HTo * 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw — — — — — — — — — ❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 — — — — — — — — — Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join — — — — — — — — — 📱 ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment