19 Tips to Better AI Fine Tuning

Matt Williams β€’ January 9, 2025
Video Thumbnail
Matt Williams Logo

Matt Williams

@technovangelist

About

I was a founding maintainer of Ollama, the first evangelist at Datadog, and a former organizer of DevOps Days Seattle, DevOps Days Boston, and Serverless Days Boston. I am passionate about gadgets and AI and automation. Some folks don't think that word is appropriate, but it totally fits here. If you meet me in person you will see me light up when I can share with you my latest gadget, tool, or utility. And this is where I get to share that with all of you. You can find more about me at my website (http://technovangelist.com) or on Twitter (http://twitter.com/technovangelist)

Video Description

πŸ”₯ Want to make your LLMs smarter? Discover the truth about fine-tuning - it's not what most people think! Learn when to use it, when to avoid it, and how to prepare for success with popular tools like Axolotl, Unsloth, and MLX. 🎯 In this video, you'll learn: β€’ What fine-tuning actually does (hint: it's not about new knowledge) β€’ The key differences between full fine-tuning, LoRA, and QLoRA β€’ How to prepare high-quality training data β€’ Which base model to choose for your project β€’ Common pitfalls to avoid ⏱️ Timestamps: 00:00 - Intro 00:29 - The first tip 00:44 - The second tip...what it does 01:17 - But wait 02:49 - The next one 03:02 - The approaches 04:33 - The first example 05:04 - The parameters 06:40 - Another tip 07:12 - Second great use case 07:39 - This tip is a mistake to avoid 07:55 - Another mistake to avoid 08:12 - RAG is often better 09:09 - Patterns 09:31 - The most crucial piece 10:13 - Another tip 10:31 - Good Data 11:01 - High quality data 11:34 - What your training data must have 12:29 - Foundations 12:55 - Model size 13:47 - Something often overlooked 14:56 - But what do i DO πŸ’‘ Want to implement fine-tuning yourself? Subscribe and hit the notification bell to catch our upcoming tutorials on Axolotl, unsloth, and MLX! Drop a comment below: Which fine-tuning tool should we cover first? πŸ‘‡ #MachineLearning #LLM #ArtificialIntelligence My Links πŸ”— πŸ‘‰πŸ» Subscribe (free): https://www.youtube.com/technovangelist πŸ‘‰πŸ» Join and Support: https://www.youtube.com/channel/UCHaF9kM2wn8C3CLRwLkC2GQ/join πŸ‘‰πŸ» Newsletter: https://technovangelist.substack.com/subscribe πŸ‘‰πŸ» Twitter: https://www.twitter.com/technovangelist πŸ‘‰πŸ» Discord: https://discord.gg/uS4gJMCRH2 πŸ‘‰πŸ» Patreon: https://patreon.com/technovangelist πŸ‘‰πŸ» Instagram: https://www.instagram.com/technovangelist/ πŸ‘‰πŸ» Threads: https://www.threads.net/@technovangelist?xmt=AQGzoMzVWwEq8qrkEGV8xEpbZ1FIcTl8Dhx9VpF1bkSBQp4 πŸ‘‰πŸ» LinkedIn: https://www.linkedin.com/in/technovangelist/ πŸ‘‰πŸ» All Source Code: https://github.com/technovangelist/videoprojects Want to sponsor this channel? Let me know what your plans are here: https://www.technovangelist.com/sponsor

AI Tuning Upgrade Kit

AI-recommended products based on this video

Loading...
EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White

EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White

(122)
$15.99
FREE delivery Mon, Feb 16 on your first order
Loading...
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

(10)
$4,269.00
FREE delivery Feb 24 - Mar 5
Loading...
Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black

Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black

(2)
$3,199.00
FREE delivery Feb 24 - Mar 5
Loading...
GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E

GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E

(115)
$1,199.00
FREE delivery Sat, Jan 3
Loading...
GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

(215)
$1,159.40
FREE delivery Sun, Aug 10
Loading...
Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

(19,722)
$315.09
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - β€ŽCT4000X10PROSSD902

Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - β€ŽCT4000X10PROSSD902

(2,557)
$358.93
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - β€ŽCT4000X9PROSSD902

Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - β€ŽCT4000X9PROSSD902

(3,702)
$326.05$260.70
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

(2,172)
$599.11
FREE delivery Jun 17 - 18
Loading...
Corsair RM1000e Fully Modular Low-Noise ATX Power Supply - Dual EPS12V Connectors - 105Β°C-Rated Capacitors - 80 Plus Gold Efficiency - Modern Standby Support - Black

Corsair RM1000e Fully Modular Low-Noise ATX Power Supply - Dual EPS12V Connectors - 105Β°C-Rated Capacitors - 80 Plus Gold Efficiency - Modern Standby Support - Black

(41)
$219.19$204.66
FREE delivery Oct 15 - 22
Loading...
Laplink PCmover Ultimate 11 - Migration of your Applications, Files and Settings from an Old PC to a New PC - Data Transfer Software - With Optional High Speed Ethernet Cable - 1 License

Laplink PCmover Ultimate 11 - Migration of your Applications, Files and Settings from an Old PC to a New PC - Data Transfer Software - With Optional High Speed Ethernet Cable - 1 License

(4,609)
$54.95
PrimeFREE delivery Sat, Jun 14
Loading...
Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

(382)
$94.95
PrimeFREE delivery Sat, Jun 14
Loading...
PNY GeForce RTXβ„’ 4070 Super 12GB Vertoβ„’ OC Dual Fan Graphics Card DLSS 3 (NVIDIA GeForce SFF-Ready, 192-bit, GDDR6X, PCIe 4.0, HDMI/DisplayPort, Supports 4k, incl. Adapter, 2 Slot)

PNY GeForce RTXβ„’ 4070 Super 12GB Vertoβ„’ OC Dual Fan Graphics Card DLSS 3 (NVIDIA GeForce SFF-Ready, 192-bit, GDDR6X, PCIe 4.0, HDMI/DisplayPort, Supports 4k, incl. Adapter, 2 Slot)

(262)
$994.99