Understanding Embeddings in RAG and How to use them - Llama-Index

Prompt Engineering September 28, 2023
Video Thumbnail
Prompt Engineering Logo

Prompt Engineering

@engineerprompt

About

👋 I'm Muhammad! I am an AI/ML Expert with a PhD and have led ML teams at startups over the last 8 years. I am also a Google Developer Expert for ML/AI. The goal of this channel is to share my learning without all the "fluff" and "hype". I offer consulting services to startups and https://calendly.com/engineerprompt/consulting-call Learn more about me @: engineerprompt.ai For business inquiries email: [email protected]

Video Description

In this video, we will take a deep dive into the World of Embeddings and understand how to use them in RAG pipeline in Llama-index. First, we will understand the concept and then will look at home to use different embeddings including OpenAI Embedding, Open source embedding (BGE, and instructor embeddings) in llama-index. We will also benchmark their speed. CONNECT: ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Support my work on Patreon: Patreon.com/PromptEngineering 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ▶️️ Subscribe: https://www.youtube.com/@engineerprompt?sub_confirmation=1 📧 Business Contact: [email protected] 💼Consulting: https://calendly.com/engineerprompt/consulting-call LINKS: Google Colab: https://tinyurl.com/mr2mf65n llama-Index RAG: https://youtu.be/WL7V9JUy2sE How to chunk Documents: https://youtu.be/n0uPzvGTFI0 llama-Index Github: https://github.com/jerryjliu/llama_index TIMESTAMPS: [00:00] Intro [01:21] What are Embeddings [03:58] How they Work! [05:54] Custom Embeddings [08:30] OpenAI Embeddings [09:33] Open-Source Embeddings [10:45] BGE Embeddings [11:42] Instructor Embeddings [11:57] Speed Benchmarking

Upgrade Your Game Now

AI-recommended products based on this video

Loading...
acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

(283)
$1,658.99
Loading...
Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

(40)
$1,399.00
FREE delivery Feb 24 - Mar 5
Loading...
Acer Nitro V 15.6" FHD 165Hz Gaming Laptop, Intel i5-13420H, 16GB RAM, 512GB SSD, NVIDIA GeForce RTX 5050 8GB GDDR7, Copilot, Backlit Keyboard, Wi-Fi 6, Win 11, Black, 1TB Docking Station Set

Acer Nitro V 15.6" FHD 165Hz Gaming Laptop, Intel i5-13420H, 16GB RAM, 512GB SSD, NVIDIA GeForce RTX 5050 8GB GDDR7, Copilot, Backlit Keyboard, Wi-Fi 6, Win 11, Black, 1TB Docking Station Set

(1,689)
$1,349.00
FREE delivery Feb 24 - Mar 5Only 7 left in stock.
Loading...
Lenovo Legion 5 15.1" WQXGA 165Hz Gaming Laptop, Intel i9 14900HX, GeForce RTX 5070 8GB GDDR7, 16GB DDR5, 2TB Storage(1TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, Windows 11, Black

Lenovo Legion 5 15.1" WQXGA 165Hz Gaming Laptop, Intel i9 14900HX, GeForce RTX 5070 8GB GDDR7, 16GB DDR5, 2TB Storage(1TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, Windows 11, Black

(68)
$2,749.00
FREE delivery Feb 24 - Mar 5
Loading...
NIDOO 15.6 inch Laptop Sleeve Case Computer Bag for 15.6" Lenovo Legion 5 / IdeaPad Gaming 3i / ThinkPad L15 T15 E15 / 16" Legion 7i 9i / Legion 5 Pro/ThinkPad E16 16p /Yoga 7i / Galaxy Book3 HP Dell

NIDOO 15.6 inch Laptop Sleeve Case Computer Bag for 15.6" Lenovo Legion 5 / IdeaPad Gaming 3i / ThinkPad L15 T15 E15 / 16" Legion 7i 9i / Legion 5 Pro/ThinkPad E16 16p /Yoga 7i / Galaxy Book3 HP Dell

(85)
$29.99$27.25
FREE delivery Mon, Jun 23 on your first order
Loading...
NIDOO Laptop Sleeve 15.6 inch Computer Bag for 15.6" Lenovo Legion 5 / Legion Slim 7 / ThinkPad T15 E15 / 16" Legion 7i / Legion 5 Pro/IdeaPad 3i / 16.1" Gaming 16 / Acer Dell Carrying Case, Black

NIDOO Laptop Sleeve 15.6 inch Computer Bag for 15.6" Lenovo Legion 5 / Legion Slim 7 / ThinkPad T15 E15 / 16" Legion 7i / Legion 5 Pro/IdeaPad 3i / 16.1" Gaming 16 / Acer Dell Carrying Case, Black

(124)
$24.99
FREE delivery Sat, Jun 21 on your first order
Loading...
New Slim 230W Charger fit for Lenovo Legion 5 7 5P C7 S7 Y520 Y740 Y730 Y900 Y910 Y920 Y7000P ThinkPad P16 P15 P73 P52 P70 ADL230NLC3A Square Yellow Tip Laptop Power Supply Adapter

New Slim 230W Charger fit for Lenovo Legion 5 7 5P C7 S7 Y520 Y740 Y730 Y900 Y910 Y920 Y7000P ThinkPad P16 P15 P73 P52 P70 ADL230NLC3A Square Yellow Tip Laptop Power Supply Adapter

(6)
$45.99
FREE delivery Sat, Jun 21
Loading...
95MM T129215SU Cooling Fan for ASUS ROG Strix for GeForce RTX 3060 3070 3080 3090 Ti Graphics Card CF1010U12S/D T129215BU(Black A-Fan T12)

95MM T129215SU Cooling Fan for ASUS ROG Strix for GeForce RTX 3060 3070 3080 3090 Ti Graphics Card CF1010U12S/D T129215BU(Black A-Fan T12)

(0)
$43.56
FREE delivery Mar 19 - Apr 10
Loading...
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

(10)
$4,269.00
FREE delivery Feb 24 - Mar 5
Loading...
ASUS ROG Strix G16 (2024) Gaming Laptop, 16” 16:10 FHD+ 165Hz, GeForce RTX 4060, Intel Core i7-13650HX, 16GB DDR5, 1TB PCIe SSD, Wi-Fi 6E, Windows 11, G614JV-AS71-CA

ASUS ROG Strix G16 (2024) Gaming Laptop, 16” 16:10 FHD+ 165Hz, GeForce RTX 4060, Intel Core i7-13650HX, 16GB DDR5, 1TB PCIe SSD, Wi-Fi 6E, Windows 11, G614JV-AS71-CA

(43)
$1,659.99$1,549.30
FREE delivery Feb 19 - 23
Loading...
Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC

Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC

(54)
$299.99
FREE delivery Jan 11 - Feb 5
Loading...
240W 180W AC Charger Fit for Dell G15 G16 G7 G5 G3 Series 5500 5505 5510 5515 5511 5520 5521 5525 5530 5535 5587 5590 7500 7588 7590 7700 7790 7620 7630 3500 3579 3590 3779 LA240PM160 Gaming Laptop

240W 180W AC Charger Fit for Dell G15 G16 G7 G5 G3 Series 5500 5505 5510 5515 5511 5520 5521 5525 5530 5535 5587 5590 7500 7588 7590 7700 7790 7620 7630 3500 3579 3590 3779 LA240PM160 Gaming Laptop

(13)
$44.99$35.81
FREE delivery Sun, Aug 24
50+ bought in past month
Loading...
MSI Thin 15 15.6" 144Hz Gaming Laptop, Intel® Core™ 5-210H, RTX 4050, 16GB DDR5, 1TB NVMe SSD, Windows 11 Home

MSI Thin 15 15.6" 144Hz Gaming Laptop, Intel® Core™ 5-210H, RTX 4050, 16GB DDR5, 1TB NVMe SSD, Windows 11 Home

(6)
$1,099.00
FREE delivery Mon, Feb 16
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
230W Charger Compatible with Razer Blade 14” 15” 16" 17” (2025-2018) RZ09 RTX-3060/3070/3080/4060/4070 Gaming Laptop RC30-0530 RC30-0238 RC30-0248 Replacement Power Adapter

230W Charger Compatible with Razer Blade 14” 15” 16" 17” (2025-2018) RZ09 RTX-3060/3070/3080/4060/4070 Gaming Laptop RC30-0530 RC30-0238 RC30-0248 Replacement Power Adapter

(16)
$67.99
FREE delivery Mon, Feb 16
Loading...
Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

(2)
$1,369.00
FREE delivery Feb 24 - Mar 5
Loading...
Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

(40)
$1,399.00
FREE delivery Feb 24 - Mar 5
Loading...
Razer BlackShark V2 X Gaming Headset: 50mm Drivers - Cardioid Mic - Memory Foam Cushion - Lightweight- Comfortable, Noise Isolating Earcups - for PC, PS4, PS5, Switch - 3.5mm Audio Jack - Black ECOLOGO

Razer BlackShark V2 X Gaming Headset: 50mm Drivers - Cardioid Mic - Memory Foam Cushion - Lightweight- Comfortable, Noise Isolating Earcups - for PC, PS4, PS5, Switch - 3.5mm Audio Jack - Black ECOLOGO

(17,449)
$54.98$48.21
FREE delivery Mon, Jan 26
3K+ bought in past month
Loading...
New SteelSeries Arctis Nova Pro for Xbox Multi-System Gaming Headset - Premium Hi-Fi Drivers - Hi-Res Audio - 360° Spatial - GameDAC Gen 2 - Quad-DAC - ClearCast Gen 2 Mic - Xbox, PC, PS5/PS4, Switch

New SteelSeries Arctis Nova Pro for Xbox Multi-System Gaming Headset - Premium Hi-Fi Drivers - Hi-Res Audio - 360° Spatial - GameDAC Gen 2 - Quad-DAC - ClearCast Gen 2 Mic - Xbox, PC, PS5/PS4, Switch

(517)
$209.41$122.65
PrimeFREE delivery Sat, Jun 14
Loading...
NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

(9,500)
$99.98$67.37
PrimeFREE delivery Sat, Jun 14
100+ bought in past month
Loading...
CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

(17)
$379.99
FREE delivery Sun, Aug 24
Loading...
CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

(56)
$149.99$125.33
FREE delivery Sun, Aug 24
Loading...
CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

(235)
$879.99
FREE delivery Sun, Aug 24
Loading...
Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

(74,910)
$169.97
FREE delivery Tue, Jun 17
50+ bought in past month