Axolotl is a AI FineTuning Magician

Matt Williams β€’ January 31, 2025
Video Thumbnail
Matt Williams Logo

Matt Williams

@technovangelist

About

I was a founding maintainer of Ollama, the first evangelist at Datadog, and a former organizer of DevOps Days Seattle, DevOps Days Boston, and Serverless Days Boston. I am passionate about gadgets and AI and automation. Some folks don't think that word is appropriate, but it totally fits here. If you meet me in person you will see me light up when I can share with you my latest gadget, tool, or utility. And this is where I get to share that with all of you. You can find more about me at my website (http://technovangelist.com) or on Twitter (http://twitter.com/technovangelist)

Video Description

πŸ”§ Want to make AI models speak like a pirate? Or customize them for your specific needs? This step-by-step tutorial shows you exactly how to fine-tune language models using Axolotl and integrate them with Ollama! 🎯 In this video, you'll learn: β€’ How to set up and configure Axolotl for model fine-tuning β€’ Complete installation process with all required dependencies β€’ Step-by-step guide to running the fine-tuning process β€’ How to integrate your fine-tuned model with Ollama β€’ Tips for troubleshooting common Python environment issues Link to the Intro to FineTuning Video: https://youtu.be/W2QuK9TwYXs Links mentioned: https://tvl.st/axolotl-amd https://tvl.st/axolotl-pirate https://tvl.st/gh-axolotl https://tvl.st/loraparams Commands used: Install: conda create -n ax python=3.11 conda activate ax conda install pytorch torchvision torchaudio pytorch-cuda -c pytorch -c nvidia git clone https://github.com/axolotl-ai-cloud/axolotl.gitΒ axolotl pip install packaging pip install -e '.[flash-attn,deepspeed]'pip install -U git+https://github.com/huggingface/peft.git pip install --upgrade "jinja2" (angled brackets not allowed in video descriptions, but I specified a version) My Links πŸ”— πŸ‘‰πŸ» Subscribe (free): https://www.youtube.com/technovangelist πŸ‘‰πŸ» Join and Support: https://www.youtube.com/channel/UCHaF9kM2wn8C3CLRwLkC2GQ/join πŸ‘‰πŸ» Newsletter: https://technovangelist.substack.com/subscribe πŸ‘‰πŸ» Twitter: https://www.twitter.com/technovangelist πŸ‘‰πŸ» Discord: https://discord.gg/uS4gJMCRH2 πŸ‘‰πŸ» Patreon: https://patreon.com/technovangelist πŸ‘‰πŸ» Instagram: https://www.instagram.com/technovangelist/ πŸ‘‰πŸ» Threads: https://www.threads.net/@technovangelist?xmt=AQGzoMzVWwEq8qrkEGV8xEpbZ1FIcTl8Dhx9VpF1bkSBQp4 πŸ‘‰πŸ» LinkedIn: https://www.linkedin.com/in/technovangelist/ πŸ‘‰πŸ» All Source Code: https://github.com/technovangelist/videoprojects Want to sponsor this channel? Let me know what your plans are here: https://www.technovangelist.com/sponsor

Boost Your AI Fine-Tuning Today

AI-recommended products based on this video

Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

(203)
$670.57$399.99
FREE delivery Feb 23 - 27
Loading...
MONSGA Robot Vacuums and mop, Powerful Suction Robotic Vacuum, 140Min Runtime, Vacuum Robot for Hard Floor, Low Pile Carpet, Pet Hair, Remote/App/Voice Control, Schedule Clean (Black)

MONSGA Robot Vacuums and mop, Powerful Suction Robotic Vacuum, 140Min Runtime, Vacuum Robot for Hard Floor, Low Pile Carpet, Pet Hair, Remote/App/Voice Control, Schedule Clean (Black)

(25)
$185.99
FREE delivery Sun, Mar 15
Loading...
AlloyMove Cordless Vacuum Cleaner, 550W 50KPA 70Mins Powerful Vacuum Cleaners for Home, with Anti-Tangle, LED Display Screen, Self-Standing Stick Vacuum for Hardwood Floors/Pet Hair/Carpet, A01

AlloyMove Cordless Vacuum Cleaner, 550W 50KPA 70Mins Powerful Vacuum Cleaners for Home, with Anti-Tangle, LED Display Screen, Self-Standing Stick Vacuum for Hardwood Floors/Pet Hair/Carpet, A01

(73)
$129.99
FREE delivery Fri, Feb 27
Loading...
Trucozie Cordless Vacuum Cleaner, Powerful 8 in 1 Lightweight Vacuum Cleaners with Max 45mins, LED Display, 2 HEPA, Stick Vacuums Cordless for Hardwood, Carpets, Tile, Pet Hair, Black

Trucozie Cordless Vacuum Cleaner, Powerful 8 in 1 Lightweight Vacuum Cleaners with Max 45mins, LED Display, 2 HEPA, Stick Vacuums Cordless for Hardwood, Carpets, Tile, Pet Hair, Black

(266)
$149.99
FREE delivery Sat, Nov 22
600+ bought in past month
Loading...
Premium Nose Pore Strips - Deep Cleansing Blackhead Remover for Men & Women, Oil & Dirt Removal, 30 Count, Designed in Canada

Premium Nose Pore Strips - Deep Cleansing Blackhead Remover for Men & Women, Oil & Dirt Removal, 30 Count, Designed in Canada

(18)
$13.99
$5.90 delivery Wed, Feb 11
Loading...
Premium Memory Foam Mattress Topper Queen Size,Plush Pillow Top with Breathable Air Mesh Sides,Extra Thick Soft Mattress Pad Cover with 8-21''Inch Deep Pocket (60x80 Inches)

Premium Memory Foam Mattress Topper Queen Size,Plush Pillow Top with Breathable Air Mesh Sides,Extra Thick Soft Mattress Pad Cover with 8-21''Inch Deep Pocket (60x80 Inches)

(45)
$159.90
PrimeFREE delivery Sat, Jun 14
Loading...
GMKtec EVO-X2 AI Mini PC Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 96GB LPDDR5X 8000MHz (12GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard

GMKtec EVO-X2 AI Mini PC Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 96GB LPDDR5X 8000MHz (12GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard

(69)
$3,259.99
FREE delivery Sat, Jan 3
Loading...
GMKtec EVO-X2 AI Mini PC, Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 64GB LPDDR5X 8000MHz (8GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard

GMKtec EVO-X2 AI Mini PC, Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 64GB LPDDR5X 8000MHz (8GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard

(71)
$2,799.99
FREE delivery Sat, Jan 3Only 10 left in stock.