Ollama: The Easiest Way to RUN LLMs Locally

Prompt Engineering • October 6, 2023
Video Thumbnail
Prompt Engineering Logo

Prompt Engineering

@engineerprompt

About

👋 I'm Muhammad! I am an AI/ML Expert with a PhD and have led ML teams at startups over the last 8 years. I am also a Google Developer Expert for ML/AI. The goal of this channel is to share my learning without all the "fluff" and "hype". I offer consulting services to startups and https://calendly.com/engineerprompt/consulting-call Learn more about me @: engineerprompt.ai For business inquiries email: [email protected]

Video Description

In this video, I will show you no-code method to run open source LLMs locally. In this easiest way, we will run Mistral-7B in Ollama and serve it via API. 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). LINKS: Ollama: https://ollama.ai/ Github: https://github.com/jmorganca/ollama Timestamps: [00:00] Intro [00:29] Ollama Setup [02:22] Ollama - Options [04:14] Ollama API

Essential Camera Gear Upgrades

AI-recommended products based on this video

Loading...
COTUBLR 31 Inch Computer Desk, Home Office Desk, Simple Modern Small Desk for Bedroom, Writing Desk with Storage Bag, Study Table for Students, Grey Oak

COTUBLR 31 Inch Computer Desk, Home Office Desk, Simple Modern Small Desk for Bedroom, Writing Desk with Storage Bag, Study Table for Students, Grey Oak

(180)
$64.99
FREE delivery Thu, Jun 26
Loading...
HEYSTOP Switch 2 Case for Nintendo Switch 2, Protective Case Compatible with Nintendo Switch 2, Switch 2 Accessories Kit with Grip Controller ,Tempered Glass Screen Protector, Thumb Stick Caps

HEYSTOP Switch 2 Case for Nintendo Switch 2, Protective Case Compatible with Nintendo Switch 2, Switch 2 Accessories Kit with Grip Controller ,Tempered Glass Screen Protector, Thumb Stick Caps

(60)
$23.99
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month
Loading...
Pink Unicorn Carrying Case Compatible with Nintendo Switch Lite with Crystal Glitter Soft Protective Case Cover+Screen Protector+Stickers, Hard Storage Case Accessories Kit for Girls Birthday Gift

Pink Unicorn Carrying Case Compatible with Nintendo Switch Lite with Crystal Glitter Soft Protective Case Cover+Screen Protector+Stickers, Hard Storage Case Accessories Kit for Girls Birthday Gift

(2,003)
$37.40
PrimeFREE delivery Mon, Jun 16
Loading...
Pink Unicorn Carrying Case Compatible with Nintendo Switch (Not OLED or Lite) with Dockable Protective Grip Case +Screen Protector +Unicorn Stickers, Hard Storage Case Accessories Kit Bundle for Girls

Pink Unicorn Carrying Case Compatible with Nintendo Switch (Not OLED or Lite) with Dockable Protective Grip Case +Screen Protector +Unicorn Stickers, Hard Storage Case Accessories Kit Bundle for Girls

(1,116)
$37.40
PrimeFREE delivery Sun, Jun 15
Loading...
HEYSTOP Case for Nintendo Switch OLED Model, Protection for Switch OLED Switch Case OLED Kit Accessories Cover for Nintendo Switch OLED with Tempered Glass Screen and Thumb Covers Grips

HEYSTOP Case for Nintendo Switch OLED Model, Protection for Switch OLED Switch Case OLED Kit Accessories Cover for Nintendo Switch OLED with Tempered Glass Screen and Thumb Covers Grips

(3,269)
$23.99$16.48
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month
Loading...
NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

(24)
$25.99
FREE delivery Thu, Jun 19 on your first order
Loading...
SmallRig ZV-E10 II Base Plate for Sony Alpha ZV-E10 II, Bottom Mount Plate with Quick-Release Plate for Arca, QD Socket, Hand Strap Hole, 1/4"-20 Threaded Hole - 4950

SmallRig ZV-E10 II Base Plate for Sony Alpha ZV-E10 II, Bottom Mount Plate with Quick-Release Plate for Arca, QD Socket, Hand Strap Hole, 1/4"-20 Threaded Hole - 4950

(13)
$37.99
FREE delivery Sat, Jun 21
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19
Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

(24)
$25.99
FREE delivery Thu, Jun 19 on your first order
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19
Loading...
NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

(2,807)
$181.49
FREE delivery Sun, Aug 10
Loading...
SanDisk 64GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXU-064G-GN4IN

SanDisk 64GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXU-064G-GN4IN

(71,074)
$21.99$16.59
FREE delivery Sun, Aug 10 on your first order
500+ bought in past month
Loading...
SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN
Best Seller

SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN

(71,074)
$29.99$26.61
FREE delivery Sun, Aug 10 on your first order
4K+ bought in past month