The Ultimate Guide to Local AI and AI Agents (The Future is Here)

Cole Medin June 12, 2025
Video Thumbnail
Cole Medin Logo

Cole Medin

@colemedin

About

Hi I'm Cole Medin and I'm your guy for learning how to make a huge impact with AI agents and AI coding assistants. AI is no doubt the future of not just software development but the whole world. And I'm on a mission to master it and share everything with you. Join me as I push the limits of what is possible with AI. I'll be uploading videos weekly - at least every Wednesday at 7:00 PM CDT!

Video Description

The future of AI and AI agents is running everything locally - your LLMs, databases, agent tooling, knowledge bases, and automation platforms. No cloud dependencies, no data leaving your machine, and full control over your AI infrastructure. There are pros and cons to local vs. cloud AI, but the advantages of cloud AI are diminishing every day and we're heading toward a future where running your own LLMs is a must - so master this now. In this masterclass, I'll walk you through everything you need to know about local AI: what it is, why it's critical, how you can run your own LLMs and infrastructure, how to create local AI agents with both n8n and Python, and finally how to deploy everything to a private server so you can productionize your local AI agents. Nothing in this video is sponsored - all platforms, LLMs, and frameworks/tools are my genuine recommendations for running all of your AI locally. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ If you're looking to join a community for early AI adopters to master AI & AI Agents and transform your career or business, check out Dynamous here: https://dynamous.ai ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ There are a LOT of resources from this masterclass, here they are! The Local AI Package: https://github.com/coleam00/local-ai-packaged The agents built in this masterclass: https://github.com/coleam00/ottomator-agents/tree/main/python-local-ai-agent The entire part list for my PC I built to run local LLMs (I did buy the 3090s used for $700 each): https://pcpartpicker.com/user/coleam00/saved/#view=3zHNvK ~~~~~~~ Ollama FAQs: https://github.com/ollama/ollama/blob/main/docs/faq.md Ollama OpenAI API compatibility: https://ollama.com/blog/openai-compatibility Supabase self-hosting docs: https://supabase.com/docs/guides/self-hosting My YouTube video for RAG with Local AI: https://youtu.be/T2QWhXpnT5I ~~~~~~~ Models on Ollama referenced in this video: DeepSeek R1: https://ollama.com/library/deepseek-r1 Qwen 3: https://ollama.com/library/qwen3 Qwen 2.5: https://ollama.com/library/qwen2.5 Mistral: https://ollama.com/library/mistral Devstral: https://ollama.com/library/devstral ~~~~~~~ Cloud platforms mentioned in this video for hosting the Local AI Package: DigitalOcean (CPU and GPU instances): https://www.digitalocean.com/ TensorDocker (GPU instances): https://tensordock.com/ Hostinger (CPU instances): https://www.hostinger.com/vps-hosting ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 00:00 - Welcome to the Local AI Masterclass 00:41 - Agenda for the Local AI Masterclass 03:23 - Dynamous AI Agent Mastery 04:26 - What is Local AI? 06:08 - Run Your 1st Local LLM in 5 Minutes w/ Ollama 10:11 - Why Local AI? (Local AI vs. Cloud AI) 16:26 - Hardware Requirements for Local LLMs 24:29 - Specific Local LLM Recommendations 28:07 - Quantization (Run Bigger LLMs) 33:08 - Downloading Quantized LLMs in Ollama 35:16 - Offloading (Splitting LLMs between GPU + CPU) 37:11 - Critical Ollama Configuration 41:45 - Ollama's OpenAI API Compatibility 45:58 - OpenAI Compatible Demo 53:20 - Introducing the Local AI Package 57:42 - Instructions for Installing the Local AI Package 1:09:07 - Customizing the Local AI Package 1:11:59 - Running the Local AI Package 1:20:24 - Testing Our Local AI Services 1:24:41 - Testing Ollama within Open WebUI 1:29:49 - Building a Local n8n AI Agent 1:47:18 - Building a Local Python AI Agent 1:57:37 - Containerizing our Local Python Agent 2:02:31 - Introduction to Deploying & Cloud Provider Options 2:07:11 - Deploying the Local AI Package to the Cloud 2:23:18 - Testing Our Deployed Local AI Package 2:25:32 - Deploying Our Python AI Agent to the Cloud 2:32:12 - Testing Our Full Agent Setup 2:36:08 - Additional Resources ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Join me as I push the limits of what is possible with AI. I'll be uploading videos every Wednesday at 7:00 PM CDT!

Upgrade Your AI Journey Today

AI-recommended products based on this video

Loading...
10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

(1)
$99.99
FREE delivery Mon, Aug 11
Loading...
ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

(49)
$117.29$102.21
$6.86 delivery Thu, Aug 14
Loading...
7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

(61)
$68.99
FREE delivery Tue, Aug 12
Loading...
BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

(288)
$54.14
FREE delivery Sun, Jun 22
Loading...
Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)
Best Seller

Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)

(78)
$6.99
FREE delivery Fri, Sep 5 on your first order
1K+ bought in past month
Loading...
100W USB C Universal Laptop Charger Fit for Lenovo MacBook HP Dell Acer Asus Thinkpad Google MSI LG Samsung Huawei, ROG Ally, Steam Deck, Chromebook Computer and All USB-C Devices

100W USB C Universal Laptop Charger Fit for Lenovo MacBook HP Dell Acer Asus Thinkpad Google MSI LG Samsung Huawei, ROG Ally, Steam Deck, Chromebook Computer and All USB-C Devices

(19)
$25.99$24.69
FREE delivery Tue, Jun 17 on your first order
100+ bought in past month
Loading...
INIU 45W Power Bank, Ultra Small 10000mAh Portable Charger, USB C in&Out Fast Charging Battery Pack, Travel External Phone Powerbank Compatible with iPhone 16 15 Samsung S25 S24 Google Pixel iPad etc

INIU 45W Power Bank, Ultra Small 10000mAh Portable Charger, USB C in&Out Fast Charging Battery Pack, Travel External Phone Powerbank Compatible with iPhone 16 15 Samsung S25 S24 Google Pixel iPad etc

(520)
$41.42
PrimeFREE delivery Sat, Jun 14
500+ bought in past month
Loading...
Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

(213)
$12.99
FREE delivery Sat, Jun 14 on your first order
100+ bought in past month
Loading...
DHT11 modules Digital Temperature and Humidity Temperature Sensor for arduino DIY KIT 5pcs

DHT11 modules Digital Temperature and Humidity Temperature Sensor for arduino DIY KIT 5pcs

(1)
$15.99
FREE delivery Sat, Jun 14 on your first order
Loading...
ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

(49)
$117.29$102.21
$6.86 delivery Thu, Aug 14
Loading...
soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

(61,759)
$29.99
FREE delivery Sat, Jun 14 on your first order
4K+ bought in past month
Loading...
The Pandy - Emotional Healing on Demand, Realistic Panda Plush for Emotional Support, Mimics Natural Movements for Realistic Comfort, Pandy Ai Plush with Ultra-Soft Fur, The Comfort Hug You Have

The Pandy - Emotional Healing on Demand, Realistic Panda Plush for Emotional Support, Mimics Natural Movements for Realistic Comfort, Pandy Ai Plush with Ultra-Soft Fur, The Comfort Hug You Have

(0)
$19.88
$4.99 delivery Aug 27 - Sep 9