LLMs with 8GB / 16GB

Alex Ziskind โ€ข December 16, 2024
Video Thumbnail
Alex Ziskind Logo

Alex Ziskind

View Channel

About

Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโ€™m Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐Ÿš€ https://www.youtube.com/@azisk?sub_confirmation=1

Video Description

Can a modern LLM like llama 2 and llama 3 run on older MacBooks like MacBook Air M1, M2, and Intel Core i5? Sort of and i depends on which model. Temperature/fan on your Mac: https://www.tunabellysoftware.com/tgpro/index.php?fpr=alex (affiliate link) Run Windows on a Mac: https://prf.hn/click/camref:1100libNI (affiliate) Use COUPON: ZISKIND10 ๐Ÿ›’ Gear Links ๐Ÿ›’ * ๐Ÿ๐Ÿ’ฅ New MacBook Air M1 Deal: https://amzn.to/3S59ID8 * ๐Ÿ’ป๐Ÿ”„ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo * ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ * ๐Ÿ› ๏ธ FREE Local LLMs on Apple Silicon - https://youtu.be/bp2eev21Qfo * ๐Ÿ’ฐ Apple's Memory Bandwidth claims - https://youtu.be/fdvzQAWXU7A * ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐Ÿ’ฐ This is what spending more on a MacBook Pro gets you - https://youtu.be/iLHrYuQjKPU * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment

You May Also Like

Upgrade Your LLM Today

AI-recommended products based on this video

Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
Skytech Chronos 3 Gaming PC Desktop, Ryzen 7 9700X 3.8 GHz (5.5GHz Turbo), NVIDIA RTX 5060 8GB, 1TB NVMe SSD, 32GB DDR5 RAM 5200 RGB, 850W Gold ATX 3 PSU, 360mm ARGB AIO, Wi-Fi, Win 11

Skytech Chronos 3 Gaming PC Desktop, Ryzen 7 9700X 3.8 GHz (5.5GHz Turbo), NVIDIA RTX 5060 8GB, 1TB NVMe SSD, 32GB DDR5 RAM 5200 RGB, 850W Gold ATX 3 PSU, 360mm ARGB AIO, Wi-Fi, Win 11

(50)
$1,995.40
FREE delivery Jul 6 - 30
Loading...
Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

(9)
$3,950.00$3,752.50
FREE delivery Wed, Jun 18
Loading...
Dell G16 Gaming Laptop 7630-16-inch QHD+ 240Hz 3ms Display, Intel Core i9-13900HX, 32GB DDR5 RAM, 1TB SSD, NVIDIA GeForce RTX 4060 8GB GDDR6, Windows 11 Home, Onsite Service - Metallic Nightshade

Dell G16 Gaming Laptop 7630-16-inch QHD+ 240Hz 3ms Display, Intel Core i9-13900HX, 32GB DDR5 RAM, 1TB SSD, NVIDIA GeForce RTX 4060 8GB GDDR6, Windows 11 Home, Onsite Service - Metallic Nightshade

(0)
$2,099.00
$11.58 delivery Aug 26 - 28
Loading...
AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

(14)
$1,999.90
Loading...
GMKtec AD-GP1 External GPU Docking Station, eGPU Enclosure with AMD Radeon 7600M XT GPU Graphics Card, HDMI2.1, DisplayPort2.0, Oculink, USB4, eGPU Dock for Mini PC Laptop Notebook Game Console

GMKtec AD-GP1 External GPU Docking Station, eGPU Enclosure with AMD Radeon 7600M XT GPU Graphics Card, HDMI2.1, DisplayPort2.0, Oculink, USB4, eGPU Dock for Mini PC Laptop Notebook Game Console

(27)
$659.99
PrimeFREE delivery Sat, Jun 14
Loading...
STGAubron Gaming Desktop PC, AMD Athlon 3000G 3.5G, Radeon RX 580 16G GDDR5, 16G RAM, 512G SSD, 600M WiFi, BT 5.0, RGB Fan x4, Windows 11 Home

STGAubron Gaming Desktop PC, AMD Athlon 3000G 3.5G, Radeon RX 580 16G GDDR5, 16G RAM, 512G SSD, 600M WiFi, BT 5.0, RGB Fan x4, Windows 11 Home

(52)
$593.99
FREE delivery Wed, Jun 18
Loading...
Gigabyte AERO 16 Gaming & Entertainment Laptop (Intel i7-12700H 14-Core, 16.0" 60Hz 4K (3840x2400), GeForce RTX 3070 Ti, 32GB RAM, 4TB PCIe SSD, Backlit KB, WiFi, USB 3.2, Win 11 Pro)

Gigabyte AERO 16 Gaming & Entertainment Laptop (Intel i7-12700H 14-Core, 16.0" 60Hz 4K (3840x2400), GeForce RTX 3070 Ti, 32GB RAM, 4TB PCIe SSD, Backlit KB, WiFi, USB 3.2, Win 11 Pro)

(0)
$11,403.11
FREE delivery Jun 23 - Jul 3
Loading...
GIGABYTE - AORUS Elite 16 Gaming Laptop - 165Hz 2560x1600 WQXGA - NVIDIA GeForce RTX 5070 - Intel Core Ultra 9 275HX - 1TB SSD with 32GB DDR5 RAM - Windows 11 Home AD (AORUS Elite 16 BWHC3USC64SH)

GIGABYTE - AORUS Elite 16 Gaming Laptop - 165Hz 2560x1600 WQXGA - NVIDIA GeForce RTX 5070 - Intel Core Ultra 9 275HX - 1TB SSD with 32GB DDR5 RAM - Windows 11 Home AD (AORUS Elite 16 BWHC3USC64SH)

(0)
$9,050.69
FREE delivery Aug 28 - Sep 8Only 3 left in stock.
Loading...
Motherboard Fit for Gigabyte Z490 AORUS Master LGA 1200 ATX Gaming Motherboard Support I9-10900K I7-10700K I5-10600K DDR4 3ร—M.2 1ร—PCI-E X16

Motherboard Fit for Gigabyte Z490 AORUS Master LGA 1200 ATX Gaming Motherboard Support I9-10900K I7-10700K I5-10600K DDR4 3ร—M.2 1ร—PCI-E X16

(0)
$666.12
FREE delivery Oct 31 - Nov 21
Loading...
Fit for GIGABYTE B365M AORUS Elite Micro ATX Intel B365 M.2 SSD 64G Double Channel Support 8 9 Gen LGA 1151 CPU Motherboard Gaming Motherboard

Fit for GIGABYTE B365M AORUS Elite Micro ATX Intel B365 M.2 SSD 64G Double Channel Support 8 9 Gen LGA 1151 CPU Motherboard Gaming Motherboard

(0)
$230.25
$5.54 delivery Aug 27 - Sep 18
Loading...
MSI Thin15 15.6โ€ FHD 144Hz Gaming Laptop, Intel i5-12450H, 32GB RAM, 1TB PCIe SSD, NVIDIA GeForce RTX 2050, Backlit Keyboard, WiFi 6, Win 11 Home, Black, 256GB Docking Station Set

MSI Thin15 15.6โ€ FHD 144Hz Gaming Laptop, Intel i5-12450H, 32GB RAM, 1TB PCIe SSD, NVIDIA GeForce RTX 2050, Backlit Keyboard, WiFi 6, Win 11 Home, Black, 256GB Docking Station Set

(1,002)
$1,339.00
FREE delivery Jun 26 - Jul 8
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
msi Crosshair 16 Gaming Laptop - with 2024 Office Lifetime License, GeForce RTX 4070, 16" FHD+ 144 Hz Display, 14th Gen Intel 16-Core i7 14650HX, Backlit KB, Windows 11 Pro (32GB DDR5 RAM | 1TB SSD)

msi Crosshair 16 Gaming Laptop - with 2024 Office Lifetime License, GeForce RTX 4070, 16" FHD+ 144 Hz Display, 14th Gen Intel 16-Core i7 14650HX, Backlit KB, Windows 11 Pro (32GB DDR5 RAM | 1TB SSD)

(0)
$7,606.98
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black
Best Seller

Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black

(16,675)
$112.99$101.69
FREE delivery Sun, Aug 10
500+ bought in past month
Loading...
Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

(2,172)
$599.11
FREE delivery Jun 17 - 18
Loading...
Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

(19,722)
$315.09
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - โ€ŽCT4000X10PROSSD902

Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - โ€ŽCT4000X10PROSSD902

(2,557)
$358.93
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - โ€ŽCT4000X9PROSSD902

Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - โ€ŽCT4000X9PROSSD902

(3,702)
$326.05$260.70
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5โ€ Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

(12,472)
$19.99$18.59
FREE delivery Sun, Aug 10 on your first order
400+ bought in past month
Loading...
BOSGAME P3 Lite Mini PC, AMD Ryzen 7 6800H Mini Computer (8C/16T, up to 4.7GHz), 24GB DDR4 1TB M.2 NVMe SSD, Triple Display Desktop Gaming PC, Pre-in Win 11 Pro, Dual LAN, WiFi 6E, BT 5.2

BOSGAME P3 Lite Mini PC, AMD Ryzen 7 6800H Mini Computer (8C/16T, up to 4.7GHz), 24GB DDR4 1TB M.2 NVMe SSD, Triple Display Desktop Gaming PC, Pre-in Win 11 Pro, Dual LAN, WiFi 6E, BT 5.2

(67)
$549.00
FREE delivery Sun, Aug 10
Loading...
ORIGIMAGIC N1 Mini PC, Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer 4K Quad Display/Dual USB-C(Support Data/PD3.0/DP) /WiFi 6E/BT5.2, Light Gaming/Office

ORIGIMAGIC N1 Mini PC, Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer 4K Quad Display/Dual USB-C(Support Data/PD3.0/DP) /WiFi 6E/BT5.2, Light Gaming/Office

(33)
$589.99
FREE delivery Sun, Aug 10
Loading...
origimagic N1 Gaming Mini PC, AMD Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer Support 4K Quad Display/WiFi 6E/BT5.2/Dual USB-C(Support Data/PD3.0/DP) Gaming/Office

origimagic N1 Gaming Mini PC, AMD Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer Support 4K Quad Display/WiFi 6E/BT5.2/Dual USB-C(Support Data/PD3.0/DP) Gaming/Office

(19)
$539.99
FREE delivery Wed, Jun 18
Loading...
2.5GbE Mini PC Firewall Micro Appliance N100 6xI226-V LAN VPN Fanless Router Computer AES-NI OPNsense HDMI DP 32GB DDR4 RAM 1TB M.2 NVMe SSD

2.5GbE Mini PC Firewall Micro Appliance N100 6xI226-V LAN VPN Fanless Router Computer AES-NI OPNsense HDMI DP 32GB DDR4 RAM 1TB M.2 NVMe SSD

(0)
$501.99
FREE delivery Jul 3 - 24
Loading...
VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC

VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC

(15)
$423.43$369.00
Prime$11.85 delivery Thu, Jun 26