Deepseek R1 671b Running and Testing on a $2000 Local AI Server

Video Description

Quad 3090 Ryzen AI Rig Build 2025 Video w/cheaper components vs EPYC Build https://youtu.be/So7tqRSZ0s8 Written Build Guide with all the Updated AI Rig Component Options and Benchmarks https://digitalspaceport.com/local-ai-home-server-build-at-high-end-3500-5000-price/ $2K EPYC LOCAL AI SERVER 512GB DDR4 RAM https://geni.us/512GB_DDR4_RAM MZ32-AR0 motherboard https://geni.us/mz32-ar0_motherboard 64 core EPYC CPU 7702 https://geni.us/EPYC_7702 7C13 https://geni.us/7C13_EPYC_CPU 7V13 https://geni.us/EPYC_7V13_CPU Rack Frame https://geni.us/GPU_Rack_Frame CPU cooler h170i elite capellix xt https://geni.us/Corsair_Elite_Cappelix 1TB NVMe - Samsung 980 Pro https://geni.us/Samsung_980_PRO 850W PSU https://geni.us/850W_PSU GPUs NVIDIA 3090 24GB https://geni.us/GPU3090 AMD 9060 XT 16GB https://geni.us/AMD-9060-XT-16GB NVIDIA 5060Ti 16GB https://geni.us/5060Ti-16GB NVIDIA 3060 12GB https://geni.us/3060_GPU_12GB Ryzen AM5 Quad GPU AI Rig Components GPU Rack Frame https://geni.us/GPU_Rack_Frame 64GB DDR5 RAM https://geni.us/64GB-DDR5-6000 GIGABYTE B650 Eagle AX https://geni.us/B650-Eagle-AX-MOBO AMD 9600x CPU https://geni.us/AMD-9600X-CPU Low Profile CPU Cooler https://geni.us/AirCooler-AM4-5LowProf ASRock 1600W PSU https://geni.us/ASRock-1600W-PSU Samsung 990 EVO plus 1TB https://geni.us/EVO-990-Plus-1TB PCIe4 Quality Risers https://geni.us/PCIe4_Riser_Cable Running and Testing Deepseek R1 671B Locally on R930 Server https://youtu.be/yFKOOK6qqT8 Deepseek R1 671b Setup and Running Locally Writeup https://digitalspaceport.com/running-deepseek-r1-locally-not-a-distilled-qwen-or-llama/ Be sure to 👍✅Subscribe✅👍 for more content like this! Join this channel https://www.youtube.com/@DigitalSpaceport/join Digital Spaceport Website https://digitalspaceport.com Patreon https://www.patreon.com/digitalspaceport Buy Me a Coffee https://buymeacoffee.com/digitalspaceport Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching! Chapters 0:00 Running Deepseek R1 671b Local Ai Rig 2:55 Deepseek Performance Guide 8:40 Local Ai Deepseek R1 671b Tokens Per Second Benchmark 9:14 Oneshot Code Testing Deepseek R1 12:43 EPYC Deepseek CPUs 24:03 Armageddon with a Twist 26:39 Sentence parsing and counting 27:57 Deductive Arrays and offsets 29:18 Numeric Comparison 30:28 Parsing Peppermints 32:35 Timing for Pico de Gato 33:39 Hundred Decimals of Pi 35:03 Create and SVG of a Smiley 37:00 Classic two car word problem 40:11 AMD EPYC LLM Bios Tuning for CPU Inference 47:02 GPU and CPU Deepseek Ai Server ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. *****