Cheap mini runs a 70B LLM 🤯

Video Description

I put 96GB of RAM in this tiny mini PC and ran Llama 70B LLM on it. Chair: Doro S100 Chair - enjoy 6%OFF: YTBZIS USA&CA: https://sihoooffice.com/DoroS100-AlexZiskind EU&UK: https://de.sihoooffice.com/DoroS100-AlexZiskind Amazon：https://amzn.to/3V9A5t8 🛒 Gear Links 🛒 * 🍏💥 K9 Mini with 32GB RAM: https://amzn.to/3ZiKjcp * 🛠️🚀 96GB RAM kit: https://amzn.to/3ZhQ4qR * 💻🔄 Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo * 📦🎮 My gear: https://www.amazon.com/shop/alexziskind 🎥 Related Videos 🎥 * 🌗 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * 🛠️ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * 🛠️ Set up Conda - https://youtu.be/2Acht_5_HTo * 🤖 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw — — — — — — — — — ❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 — — — — — — — — — Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join — — — — — — — — — 📱 ALEX ON X: https://twitter.com/digitalix #sihoo #sihoodoros100 #DefyGravityWithSihoo #machinelearning #llm #softwaredevelopment