19 Tips to Better AI Fine Tuning
Matt Williams
@technovangelistAbout
I was a founding maintainer of Ollama, the first evangelist at Datadog, and a former organizer of DevOps Days Seattle, DevOps Days Boston, and Serverless Days Boston. I am passionate about gadgets and AI and automation. Some folks don't think that word is appropriate, but it totally fits here. If you meet me in person you will see me light up when I can share with you my latest gadget, tool, or utility. And this is where I get to share that with all of you. You can find more about me at my website (http://technovangelist.com) or on Twitter (http://twitter.com/technovangelist)
Latest Posts
Video Description
π₯ Want to make your LLMs smarter? Discover the truth about fine-tuning - it's not what most people think! Learn when to use it, when to avoid it, and how to prepare for success with popular tools like Axolotl, Unsloth, and MLX. π― In this video, you'll learn: β’ What fine-tuning actually does (hint: it's not about new knowledge) β’ The key differences between full fine-tuning, LoRA, and QLoRA β’ How to prepare high-quality training data β’ Which base model to choose for your project β’ Common pitfalls to avoid β±οΈ Timestamps: 00:00 - Intro 00:29 - The first tip 00:44 - The second tip...what it does 01:17 - But wait 02:49 - The next one 03:02 - The approaches 04:33 - The first example 05:04 - The parameters 06:40 - Another tip 07:12 - Second great use case 07:39 - This tip is a mistake to avoid 07:55 - Another mistake to avoid 08:12 - RAG is often better 09:09 - Patterns 09:31 - The most crucial piece 10:13 - Another tip 10:31 - Good Data 11:01 - High quality data 11:34 - What your training data must have 12:29 - Foundations 12:55 - Model size 13:47 - Something often overlooked 14:56 - But what do i DO π‘ Want to implement fine-tuning yourself? Subscribe and hit the notification bell to catch our upcoming tutorials on Axolotl, unsloth, and MLX! Drop a comment below: Which fine-tuning tool should we cover first? π #MachineLearning #LLM #ArtificialIntelligence My Links π ππ» Subscribe (free): https://www.youtube.com/technovangelist ππ» Join and Support: https://www.youtube.com/channel/UCHaF9kM2wn8C3CLRwLkC2GQ/join ππ» Newsletter: https://technovangelist.substack.com/subscribe ππ» Twitter: https://www.twitter.com/technovangelist ππ» Discord: https://discord.gg/uS4gJMCRH2 ππ» Patreon: https://patreon.com/technovangelist ππ» Instagram: https://www.instagram.com/technovangelist/ ππ» Threads: https://www.threads.net/@technovangelist?xmt=AQGzoMzVWwEq8qrkEGV8xEpbZ1FIcTl8Dhx9VpF1bkSBQp4 ππ» LinkedIn: https://www.linkedin.com/in/technovangelist/ ππ» All Source Code: https://github.com/technovangelist/videoprojects Want to sponsor this channel? Let me know what your plans are here: https://www.technovangelist.com/sponsor
You May Also Like
AI Tuning Upgrade Kit
AI-recommended products based on this video

EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White

ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black

GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E

GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - βCT4000X10PROSSD902

Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - βCT4000X9PROSSD902

Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

Corsair RM1000e Fully Modular Low-Noise ATX Power Supply - Dual EPS12V Connectors - 105Β°C-Rated Capacitors - 80 Plus Gold Efficiency - Modern Standby Support - Black

Laplink PCmover Ultimate 11 - Migration of your Applications, Files and Settings from an Old PC to a New PC - Data Transfer Software - With Optional High Speed Ethernet Cable - 1 License

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code



















