Axolotl is a AI FineTuning Magician
Matt Williams
@technovangelistAbout
I was a founding maintainer of Ollama, the first evangelist at Datadog, and a former organizer of DevOps Days Seattle, DevOps Days Boston, and Serverless Days Boston. I am passionate about gadgets and AI and automation. Some folks don't think that word is appropriate, but it totally fits here. If you meet me in person you will see me light up when I can share with you my latest gadget, tool, or utility. And this is where I get to share that with all of you. You can find more about me at my website (http://technovangelist.com) or on Twitter (http://twitter.com/technovangelist)
Latest Posts
Video Description
π§ Want to make AI models speak like a pirate? Or customize them for your specific needs? This step-by-step tutorial shows you exactly how to fine-tune language models using Axolotl and integrate them with Ollama! π― In this video, you'll learn: β’ How to set up and configure Axolotl for model fine-tuning β’ Complete installation process with all required dependencies β’ Step-by-step guide to running the fine-tuning process β’ How to integrate your fine-tuned model with Ollama β’ Tips for troubleshooting common Python environment issues Link to the Intro to FineTuning Video: https://youtu.be/W2QuK9TwYXs Links mentioned: https://tvl.st/axolotl-amd https://tvl.st/axolotl-pirate https://tvl.st/gh-axolotl https://tvl.st/loraparams Commands used: Install: conda create -n ax python=3.11 conda activate ax conda install pytorch torchvision torchaudio pytorch-cuda -c pytorch -c nvidia git clone https://github.com/axolotl-ai-cloud/axolotl.gitΒ axolotl pip install packaging pip install -e '.[flash-attn,deepspeed]'pip install -U git+https://github.com/huggingface/peft.git pip install --upgrade "jinja2" (angled brackets not allowed in video descriptions, but I specified a version) My Links π ππ» Subscribe (free): https://www.youtube.com/technovangelist ππ» Join and Support: https://www.youtube.com/channel/UCHaF9kM2wn8C3CLRwLkC2GQ/join ππ» Newsletter: https://technovangelist.substack.com/subscribe ππ» Twitter: https://www.twitter.com/technovangelist ππ» Discord: https://discord.gg/uS4gJMCRH2 ππ» Patreon: https://patreon.com/technovangelist ππ» Instagram: https://www.instagram.com/technovangelist/ ππ» Threads: https://www.threads.net/@technovangelist?xmt=AQGzoMzVWwEq8qrkEGV8xEpbZ1FIcTl8Dhx9VpF1bkSBQp4 ππ» LinkedIn: https://www.linkedin.com/in/technovangelist/ ππ» All Source Code: https://github.com/technovangelist/videoprojects Want to sponsor this channel? Let me know what your plans are here: https://www.technovangelist.com/sponsor
You May Also Like
Boost Your AI Fine-Tuning Today
AI-recommended products based on this video

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

PNY NVIDIA Quadro RTX 4000 - The WorldβS First Ray Tracing GPU

MONSGA Robot Vacuums and mop, Powerful Suction Robotic Vacuum, 140Min Runtime, Vacuum Robot for Hard Floor, Low Pile Carpet, Pet Hair, Remote/App/Voice Control, Schedule Clean (Black)

AlloyMove Cordless Vacuum Cleaner, 550W 50KPA 70Mins Powerful Vacuum Cleaners for Home, with Anti-Tangle, LED Display Screen, Self-Standing Stick Vacuum for Hardwood Floors/Pet Hair/Carpet, A01

Trucozie Cordless Vacuum Cleaner, Powerful 8 in 1 Lightweight Vacuum Cleaners with Max 45mins, LED Display, 2 HEPA, Stick Vacuums Cordless for Hardwood, Carpets, Tile, Pet Hair, Black

Premium Nose Pore Strips - Deep Cleansing Blackhead Remover for Men & Women, Oil & Dirt Removal, 30 Count, Designed in Canada

Premium Memory Foam Mattress Topper Queen Size,Plush Pillow Top with Breathable Air Mesh Sides,Extra Thick Soft Mattress Pad Cover with 8-21''Inch Deep Pocket (60x80 Inches)

GMKtec EVO-X2 AI Mini PC Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 96GB LPDDR5X 8000MHz (12GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard



















