Llama 3.2 just dropped and it destroys 100B models… let’s run it
David Ondrej
•
September 26, 2024
David Ondrej
@davidondrejAbout
"The greatest danger is not that our aim is too high and we miss it, but that it is too low and we reach it." - Michelangelo
Latest Posts
Video Description
Work with David directly: https://gvw0h8ku6fc.typeform.com/to/oSg694t1 (limited to 5 people) Learn how to automate your work with AI Agents: https://www.skool.com/new-society Ollama: https://ollama.com/ AnythingLLM: https://anythingllm.com/ HuggingFace: https://huggingface.co/collections/meta-llama/llama-32-66f448ffc8c32f949b04c8cf Groq API: https://console.groq.com/docs/quickstart Please subscribe. Follow me on Instagram - https://www.instagram.com/thedavit Follow me on Twitter - https://x.com/DavidOndrej1 0:00 Intro 0:27 Llama 3.2 is here! 2:52 Installing AnythingLLM 7:25 Vision Models - Llama 90B 9:40 Groq API 12:44 Building agents Llama 3.2 just released and in this video I show you how to run it locally and build AI Agents with it.
You May Also Like
Upgrade Your AI Toolkit Now
AI-recommended products based on this video
Loading...
EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White
(122)
$15.99
FREE delivery Mon, Feb 16 on your first order
Loading...
for 90MM Video Card Cooler Fan for GPU for MSI GeForce for RTX 3060 3070 3080 3090 3060Ti 3070TI for Gaming X Trio Graphics(1pcs)
(0)
$38.13
FREE delivery Mar 19 - Apr 10
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)
(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
![SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]](https://m.media-amazon.com/images/I/911ujeCkGfL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]
(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
![SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]](https://m.media-amazon.com/images/I/71W2nK7LUrL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]
(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
![SAMSUNG 990 PRO SSD 4TB PCIe Gen4 NVMe M.2 Internal Solid State Hard Drive, Up to 7,450MB/s, Heat Control, Direct Storage and Memory Expansion, MZ-V9P4T0B/AM [Canada Version]](https://m.media-amazon.com/images/I/81WuG6lQuDL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 990 PRO SSD 4TB PCIe Gen4 NVMe M.2 Internal Solid State Hard Drive, Up to 7,450MB/s, Heat Control, Direct Storage and Memory Expansion, MZ-V9P4T0B/AM [Canada Version]
(12,872)
$499.97$407.80
FREE delivery Tue, Jun 17
300+ bought in past month
Loading...
VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC
(15)
$423.43$369.00
Prime$11.85 delivery Thu, Jun 26
Loading...
Asus ROG Strix B550-F Gaming WiFi II AMD AM4 (3rd Gen Ryzen) ATX Motherboard (PCIe 4.0,WiFi 6E, 2.5Gb LAN, BIOS Flashback, HDMI 2.1, Addressable Gen 2 RGB Header and Aura Sync)
(12,062)
$239.91$169.99
FREE delivery Jan 19 - 28
100+ bought in past month
Loading...
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set
(10)
$4,269.00
FREE delivery Feb 24 - Mar 5
Loading...
Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black
(2)
$3,199.00
FREE delivery Feb 24 - Mar 5
Loading...
GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E
(115)
$1,199.00
FREE delivery Sat, Jan 3
Loading...
GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display
(215)
$1,159.40
FREE delivery Sun, Aug 10
Loading...
Apple iPad Mini (A17 Pro): Apple Intelligence, 8.3-inch Liquid Retina Display, 128GB, Wi-Fi 6E, 12MP Front/12MP Back Camera, Touch ID, All-Day Battery Life — Purple
(223)
$599.98$569.98
FREE delivery Sat, Sep 20
100+ bought in past month
Loading...
Best Seller
Teeran Wired Apple CarPlay to Wireless Adapter, 2025 Upgrade, Mini USB Design for Cars, Seamless Use Fast Stable Connection Built-in Car Play Dongle for iPhone Global Recycled Standard
(1,472)
$49.99
Prime
4K+ bought in past month
Loading...
Wireless CarPlay Adapter for Apple iPhone - Upgrade Wired CarPlay to Wireless Device, Mini T-Shaped for Car USB Plug and Play Auto Reconnect, for Vehicle GPS Navigation Car Stereo Receivers, Black
(72)
$39.47
FREE delivery Mon, Feb 9
300+ bought in past month
Loading...
Metapen Air 8 Apple Pencil for iPad 2018-2025, 20H Battry Life, 2Min Fast Charging, Palm Rejection, Stylus Pen for iPad 11/10/9/8/7/6th, iPad Pro 12.9/11/13“M4, iPad Air 3/4/5/6/M2/M3, iPad mini 5/6
(1,985)
$14.22
FREE delivery Tue, Sep 9 on your first order
1K+ bought in past month