How To Host AI Locally: Ollama and Open WebUI

Video Description

AI chatbots are taking over the world. But if you want to guarantee your privacy when using them, running an LLM locally is going to be your best bet. In this video I collaborate with The Hated One to show you how, and to explain some AI terminology so that you understand what's going on. 00:00 Your Data is Used to Train Chatbots 01:11 Understanding AI Models 01:28 LLM 02:23 Parameters 03:34 Size 04:51 AI Engine and UX 07:15 Tutorial, courtesy of The Hated One 08:07 Ollama 12:40 Open Web UI installation 13:23 Docker 15:30 Setting up Open Web UI 16:38 Choose to Take Control of Your Data The biggest advantage of open source models is that you can fine tune them using your own instructions while keeping all data private and confidential. Why trust your data to someone else when you don’t have to? A huge thank you to The Hated One for his tutorial. You can find his playlist for staying anonymous here: https://www.youtube.com/watch?v=G_QsQp7DyjE&list=PLR_ghQEN2SgDLpuLMLa_0hjJZgrlHoi0a The first video in our AI privacy series, about private cloud-based AI: https://youtu.be/rriStH1eTH0 Brought to you by NBTV team members: The Hated One, Reuben Yap, Lee, Cube Boy, Sam Ettaro, Will Sandoval and Naomi Brockwell To support NBTV, visit: https://www.nbtv.media/support (tax-deductible in the US) Visit our shop! https://Shop.NBTV.media Our eBook "Beginner's Introduction To Privacy: https://amzn.to/3WDSfku Beware of scammers, I will never give you a phone number or reach out to you with investment advice. I do not give investment advice. Watch this on Odysee! https://odysee.com/@NaomiBrockwell:4/Local-LLM:d ________________________________________________________________________ Here are a bunch of products I like and use. Using these links helps support the channel and future videos! Recommended Books: Beginner's Introduction To Privacy - Naomi Brockwell https://amzn.to/3WDSfku Permanent Record - Edward Snowden https://amzn.to/305negc What has the government done to our money - Rothbard https://amzn.to/2KMzmcu Extreme Privacy - Michael Bazzel (The best privacy book I've ever read) https://amzn.to/4jrseiS Digital version: https://inteltechniques.com/book7.html (non affiliate link) No Place to Hide: Edward Snowden, the NSA, and the U.S. Surveillance State - Glenn Greenwald https://amzn.to/2UQmJ4m Some of my favorite products to help protect your privacy! Brave browser: https://brave.com/nao076 Faraday bag (signal stopping, to protect your fob, credit card, computer, and phone) https://amzn.to/3z02UiF Data Blocker (if you're charging your phone in an unknown port, use this so that no data is transferred) https://amzn.to/2SVh0J2 Camera tape (electrical tape is the best tape for covering phone and computer cameras) https://amzn.to/3Xn8xBn USB-C to ethernet adapter: https://amzn.to/2lOVBoy Privacy Screens (use your phone and computer in public? Keep your information safe!) Computer: (Search for the size right for your computer) MacBook Air 13" https://amzn.to/3VQvpZ7 HP/Dell/Acer/Asus/Lenovo 15.6" https://amzn.to/3KK1Oda Lenovo Thinkpad/HP Elitebook/Dell 14" https://amzn.to/4enT2zq Phone: (Search for the size for your phone, decide whether you want glass or plastic!) Galaxy s24 - https://amzn.to/3VGgb8H iPhone 15 - https://amzn.to/45vCd1h Pixel 8 - https://amzn.to/3KFDuJF