Building an AI Home Server - Can LLMs Run Locally? PART 1
About
No channel description available.
Latest Posts
Video Description
Can a local AI server actually replace the cloud at home? I’ve built a rack-friendly Threadripper rig and run some tests to see what it can do. In the next video we will move to Proxmox, GPU passthrough and tuning across RTX 3090 and W7800. Subscribe so you don’t miss the virtualised tests and optimisations. Home AI Server - Setting Up // I Created A Tool To Test AI. PART 2 - https://youtu.be/-TIp-6EWoEw ---------------------------------------------------------------------------------------------------------------------------------------------- Affiliate disclosure: as an Amazon Associate, we may earn commissions from qualifying purchases from Amazon at no extra cost to you. Thank you for your support! ASUS Pro WS TRX50-SAGE WIFI Amazon: https://geni.us/BbJLur AMD Ryzen Threadripper 7970X Amazon: https://geni.us/yzLlf G.SKILL Zeta R5 NEO Series Amazon: https://geni.us/nys6up Noctua NH-D9 TR5-SP6 4U Amazon: https://geni.us/zZOQ AMD Radeon Pro W7800 Amazon: https://geni.us/cE0K Palit RTX 3090 GamingPro Unavailable Kingston SA400S37/480G A400 SSD 480GB Amazon: https://geni.us/yrssUBS Kingston Fury Renegade G5 Amazon: https://geni.us/CRQPMA Music from Artlist. Sign up and get 2 extra months for free: https://geni.us/a2k_artlist Main Set: Sit/Stand Ergonomic desk from Everdesk+ Our Gear Main Camera Amazon https://geni.us/ew4bW Zoom lens: Amazon: https://geni.us/po8arxf Lazada: https://bit.ly/2HGJGnk Wide angle lens: Amazon: https://geni.us/GV1qFYY Lazada: https://bit.ly/31Rlmq1 Mic https://geni.us/mrkWeym YouTube Management Tool - Tube Buddy Sign up for free now! -https://www.tubebuddy.com/A2K Follow us on Instagram: https://www.instagram.com/a2kpage Check out A2K blog: www.a2kmedia.net Chapters: 00:00 - Intro 00:33 - Motherboard: ASUS Pro WS TRX50 Sage 01:00 - CPU: Threadripper 7970X 01:18 - GPU 1: RTX 3090 01:31 - GPU 2: Radeon Pro W7800 01:55 - Cooling: Noctua NH-D9 TR5-SP6 02:10 - Storage plan: Kingston SATA OS + Gen5 NVMe 02:41 - RAM: G.Skill Fury 128 GB DDR5-6400 03:18 - Build: board tour 04:56 - Installing the Threadripper 07:09 - NVMe placement: Gen4 vs Gen5 slots 09:33 - Cooler installation 12:47 - Memory install tips 14:29 - SATA OS drives, Windows now, Proxmox next 17:06 - W7800 vs chunky 3090 19:35 - Boot fix 20:21 - Cinebench multi-core results 22:27 - Gen5 RAID0 - CrystalDiskMark 23:35 - LM Studio small model GPTOSS 24:48 - Larger model offload: VRAM limits explained 26:37 - Wrap-up: Virtualisation and next steps #AIhomeServer #aiserver #localllm
Upgrade Your Everyday
AI-recommended products based on this video
Kasa Smart Outdoor Smart Plug by TP-Link (KP400) - Smart WiFi Outlet with 2 Sockets, IP64 Waterproof, Works with Alexa and Google Home, 2.4GHz WiFi Required, No Hub Required, Sunset & Sunrise Offset
Open Ear Wireless Earbuds, Sports Bluetooth Headphones with Real Time Translation, 80Hrs Playtime with LED Power Display, Noise Canceling Headset, IP55 Waterproof Earphones for Workout/Running (Black)
Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running Z(Black)
Monster Wireless Earbuds Open Ear AC311, Bluetooth 5.4 Open Ear Headphones, Up to 30 Hours Playtimes Bluetooth Ear Earphones with Stereo Sound, Touch Control and IPX5 Waterproof Open Ear Buds
Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running Z(Black)
Brita Stainless Steel Premium Filtering Water Bottle, BPA-Free, Reusable, Insulated, Replaces 300 Plastic Water Bottles, Filter Lasts 2 Months or 40 Gallons, Includes 1 Filter, Carbon - 20 oz.
Simple Modern Filtered Water Bottle | Insulated Stainless-Steel Carbon Filter Travel Water Bottles | Reusable for Clean Drinking Water On The Go | 24oz, Sea Glass Sage
FITVII Health & Fitness Tracker (Answer/Make Calls), Smart Watch with 24/7 Heart Rate and Blood Pressure, Sleep Tracking Monitor, 120+ Sport Mode Activity Tracker
AYATAHA AYATAHA Smart Watch for Kids, Smartwatch Fitness Tracker for Boys Girls, Children's Activity Watch 37 Sports Modes SMS Notification, HD Full Touchscreen IP67 Waterproof, Blue
Iaret Iaret Smart Watch for Women, 1.83" HD Fitness Tracker with 4 Bands, Answer/Make Calls, Heart Rate/Sleep/SpO2/Step Tracking, 100+ Sport Modes, Android/iPhone Compatible Gift (Rose Gold)
Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in
Hand Warmers 2 Pack, 14000mAh Rechargeable Hand Warmers, Electric Hand Warmer Reusable, Portable Power Bank USB Hand Warmers 4 Levels 8 Heating, Gifts for Raynauds Ski Golf Camping
Hand Warmers Rechargeable, 10000mAh Electric Heated Gloves Power Bank Portable Graphene Handwarmers Pouch with 3 Levels & Double-Sided Heating for Hunting Camping Golf Xmas Gifts for Women Men Kids
2Pack Rechargeable Hand Warmer, 8000mAh Electric Hand Warmer Power Bank, Portable USB-C Hand Warmer for Pocket, Reusable Hand Warmer Up to 8 hrs Each, Warm Gift for Men Women, for Hunting, Camping
GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black
Monster Sleep Ear200, Wireless in-Ear Headphones, Bluetooth 6.0 Sleep Headphones, with ANC Active Noise Cancellation Designed for Side Sleepers, 30 Hours of bass Stereo Sound.
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, White
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black
Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages
Umbra Triflora Hanging Planter for Window, Indoor Herb Garden, Set of 5, White/Black
Large Hydroponics Growing System 14 Pods, Indoor Herb Garden with LED Grow Light, 5L Water Tank, Hydroponic Grow Kit with 3 Auto-Timers, Rotatable Light Panel and Child Lock for Home School Gardening
Hanging Planter Hanging Plant Holder, 6 Inch 4 Indoor Plant Pots, Wall/Window Plant Hanger Indoor Herb Garden
slopehill Multi Hair Stylers & Hair Straightener - 2 in 1 Wet to Dry Air Straightener and Hair Dryer Combo with High Speed Air + Rapid Heat-Up + Customizable Temperature(Pink)
Hi.FANCY Portable Laptop Stand with Dual Cooling Fans for 14-17inch Laptops, Grey, 23.5 x 25.9 x 0.95cm
Laptop Stand for Desk, Adjustable Laptop Riser ABS+Silicone Foldable Portable Laptop Holder, Ventilated Cooling Notebook Stand for 10-15.6” Laptops,Tablet-Black
JETech 5 in 1 Case for Samsung Galaxy S25 Ultra 5G with 2-Pack Each Tempered Glass Screen Protector and Camera Lens Protector, Non-Yellowing Shockproof Bumper Phone Cover (Clear)
TAURI for iPhone 17 Pro Max Case 6.9" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard
TAURI for iPhone 17 Pro Case 6.3" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard
JOINPAYA 1Set Rechargeable Hand Warmer Hand Heater for Winter Heating Levels Compact
Shakven Rechargeable Hand Warmer | Cute Comfortable Portable Hand Warmers,Ergonomic Adjustable Energy-Efficient Small Heater for Travel, Outdoor, Winter
OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO
