Cosine Similarity ← Natural Language Processing ← Socratica

Socratica β€’ February 29, 2024
Video Thumbnail
Socratica Logo

Socratica

View Channel

About

Socratica makes high-quality educational videos on ♾️ math πŸ§ͺ science πŸ’» computer programming and more! We're a couple of Caltech grads who believe you deserve better videos. You'll #LearnMore with us. πŸ¦‰ Check out our COURSES on our website!

Video Description

𝙄𝙣𝙩𝙧𝙀𝙙π™ͺπ™˜π™žπ™£π™œ π™Žπ™€π™˜π™§π™–π™©π™žπ™˜π™– π˜Ύπ™Šπ™π™π™Žπ™€π™Ž https://www.socratica.com/collections Cosine Similarity is a way to compare two pieces of text (docs) to see how similar they are stylistically. This is a useful technique from Natural Language Processing, a growing subfield of AI & Machine Learning. In this lesson, we review how to use the bag of words technique to turn a piece of text into a vector, then show how the 'cosine similarity' measure is a useful way to compare two docs. As a concrete application, we compare 10 different classic novels from different authors and time periods to see how well the cosine similarity measure performs. 𝙔𝙀π™ͺ π™˜π™–π™£ π™Ÿπ™ͺ𝙒π™₯ 𝙩𝙀 π™¨π™šπ™˜π™©π™žπ™€π™£π™¨ 𝙀𝙛 π™©π™π™š π™«π™žπ™™π™šπ™€ π™π™šπ™§π™š: 0:00 Intro 0:48 Prerequisites 1:43 The Big Idea 3:39 Cosine Similarity 4:42 Example setup 5:47 The Books 6:51 Building a Feature Vector 8:56 Writing the Functions 10:08 Computing Cosine similarities 11:30 No Stop Words 12:50 Analysis 14:00 No Nouns π™’π˜Όπ™π˜Ύπ™ƒ 𝙉𝙀𝙓𝙏: Bag of Words https://youtu.be/kLMhePA3BiY Use Mathematica for Free https://youtu.be/rGzmG1uXklM BTWβ€”Socratica offers a pro course, 'Mathematica Essentials,' providing key concepts for mastering Wolfram products: https://www.socratica.com/courses/mathematica-essentials Thank you to our VIP Patreon Members who helped make this video possible! JosΓ© Juan Francisco Castillo Rivera KW M Andrews Jim Woodworth Marcos Silveira Christopher Kemsley Eric Eccleston Jeremy Shimanek Michael Shebanow Alvin Khaled Kevin B John Krawiec Umar Khan Tracy Karin Prell β€” Thank you kind friends! πŸ’œπŸ¦‰ ✷✷✷ We recommend the following (affiliate links): The Wolfram Language https://amzn.to/3D4jqvz The Mythical Man Month - Essays on Software Engineering & Project Management http://amzn.to/2tYdNeP Innumeracy: Mathematical Illiteracy and Its Consequences http://amzn.to/2ri1nf7 Mindset by Carol Dweck https://amzn.to/2q9y8Nj How to Be a Great Student (our first book!) ebook: https://amzn.to/2Lh3XSP Paperback: https://amzn.to/3t5jeH3 Kindle Unlimited: https://amzn.to/3atr8TJ ✷✷✷ If you find our work at Socratica valuable, please consider becoming our Patron on Patreon! https://www.patreon.com/socratica If you would prefer to make a one-time donation, you can also use Socratica Paypal https://www.paypal.me/socratica ✷✷✷ Written & Produced by Michael Harrison & Kimberly Hatch Harrison Edited by Megi Shuke About our Instructors: Michael earned his BS in Math from Caltech, and did his graduate work in Math at UC Berkeley and University of Washington, specializing in Number Theory. A self-taught programmer, Michael taught both Math and Computer Programming at the college level. He applied this knowledge as a financial analyst (quant) and as a programmer at Google. Kimberly earned her BS in Biology and another BS in English at Caltech. She did her graduate work in Molecular Biology at Princeton, specializing in Immunology and Neurobiology. Kimberly spent 16+ years as a research scientist and a dozen years as a biology and chemistry instructor. Michael and Kimberly Harrison co-founded Socratica. Their mission? To create the education of the future. ✷✷✷ Welcome to Socratica! We make SMART videos focusing on STEM - science, math, programming. Subscribe here: http://bit.ly/SocraticaSubscribe PLAYLISTS Study Tips http://bit.ly/StudyTipsPlaylist Python programming http://bit.ly/PythonSocratica SQL programming http://bit.ly/SQL_Socratica Chemistry http://bit.ly/Chemistry_Playlist Abstract Algebra http://bit.ly/AbstractAlgebra Astronomy http://bit.ly/AstronomySocratica Biology http://bit.ly/BiologySocratica Calculus http://bit.ly/CalculusSocratica Geometry https://bit.ly/GeometrySocratica Mathematica http://bit.ly/SocraticaMathematica #cosinesimilarity #AI #naturallanguageprocessing

You May Also Like

Upgrade Your Everyday

AI-recommended products based on this video

Loading...
Kasa Smart Outdoor Smart Plug by TP-Link (KP400) - Smart WiFi Outlet with 2 Sockets, IP64 Waterproof, Works with Alexa and Google Home, 2.4GHz WiFi Required, No Hub Required, Sunset & Sunrise Offset

Kasa Smart Outdoor Smart Plug by TP-Link (KP400) - Smart WiFi Outlet with 2 Sockets, IP64 Waterproof, Works with Alexa and Google Home, 2.4GHz WiFi Required, No Hub Required, Sunset & Sunrise Offset

(28,846)
$21.99$17.99
FREE delivery Wed, Aug 20 on your first order
1K+ bought in past month
Loading...
Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running(Black)

Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running(Black)

(299)
$32.99
Prime
Loading...
Wireless Earbuds, Bluetooth 5.4 Headphones HiFi Stereo with 4 HD Mic, 50H Playtime Bluetooth Earbuds with LED Display, IPX7 Waterproof Wireless Earphones, Touch Control Ear Buds,USB-C White

Wireless Earbuds, Bluetooth 5.4 Headphones HiFi Stereo with 4 HD Mic, 50H Playtime Bluetooth Earbuds with LED Display, IPX7 Waterproof Wireless Earphones, Touch Control Ear Buds,USB-C White

(228)
$26.99
Prime
Loading...
Wireless Earbuds, Bluetooth Ear Buds 5.4 Mini HiFi Stereo with 4 ENC Noise Cancelling Mics Wireless Headphones, in Ear Earphones 40H IP7 Waterproof, USB C, Bluetooth Earbuds for Sports, Gym, Rose

Wireless Earbuds, Bluetooth Ear Buds 5.4 Mini HiFi Stereo with 4 ENC Noise Cancelling Mics Wireless Headphones, in Ear Earphones 40H IP7 Waterproof, USB C, Bluetooth Earbuds for Sports, Gym, Rose

(323)
$31.99
FREE delivery Wed, Dec 3 on your first order
500+ bought in past month
Loading...
soundcore P31i by Anker, Real-Time Adaptive Noise Cancelling, Hi-Res Sound, Translation Earbuds, 50H Playtime, Wireless Earbuds, Bluetooth Earphones, Spatial Audio, Fast Charging, IP55 ClimatePartner certified

soundcore P31i by Anker, Real-Time Adaptive Noise Cancelling, Hi-Res Sound, Translation Earbuds, 50H Playtime, Wireless Earbuds, Bluetooth Earphones, Spatial Audio, Fast Charging, IP55 ClimatePartner certified

(105)
$39.99
FREE delivery Thu, Nov 27
Loading...
Brita Stainless Steel Premium Filtering Water Bottle, BPA-Free, Reusable, Insulated, Replaces 300 Plastic Water Bottles, Filter Lasts 2 Months or 40 Gallons, Includes 1 Filter, Carbon - 20 oz.

Brita Stainless Steel Premium Filtering Water Bottle, BPA-Free, Reusable, Insulated, Replaces 300 Plastic Water Bottles, Filter Lasts 2 Months or 40 Gallons, Includes 1 Filter, Carbon - 20 oz.

(2,652)
$81.37$76.36
FREE delivery Sep 29 - Oct 2
Loading...
Simple Modern Filtered Water Bottle | Insulated Stainless-Steel Carbon Filter Travel Water Bottles | Reusable for Clean Drinking Water On The Go | 24oz, Sea Glass Sage

Simple Modern Filtered Water Bottle | Insulated Stainless-Steel Carbon Filter Travel Water Bottles | Reusable for Clean Drinking Water On The Go | 24oz, Sea Glass Sage

(26)
$30.13
FREE delivery Tue, Sep 23 on your first order
Loading...
FITVII Health & Fitness Tracker (Answer/Make Calls), Smart Watch with 24/7 Heart Rate and Blood Pressure, Sleep Tracking Monitor, 120+ Sport Mode Activity Tracker

FITVII Health & Fitness Tracker (Answer/Make Calls), Smart Watch with 24/7 Heart Rate and Blood Pressure, Sleep Tracking Monitor, 120+ Sport Mode Activity Tracker

(198)
$59.99
FREE delivery Sun, Aug 10
100+ bought in past month
Loading...
AYATAHA AYATAHA Smart Watch for Kids, Smartwatch Fitness Tracker for Boys Girls, Children's Activity Watch 37 Sports Modes SMS Notification, HD Full Touchscreen IP67 Waterproof, Blue

AYATAHA AYATAHA Smart Watch for Kids, Smartwatch Fitness Tracker for Boys Girls, Children's Activity Watch 37 Sports Modes SMS Notification, HD Full Touchscreen IP67 Waterproof, Blue

(55)
$41.99
PrimeFREE delivery Sat, Jun 14
Loading...
Iaret Iaret Smart Watch for Women, 1.83" HD Fitness Tracker with 4 Bands, Answer/Make Calls, Heart Rate/Sleep/SpO2/Step Tracking, 100+ Sport Modes, Android/iPhone Compatible Gift (Rose Gold)

Iaret Iaret Smart Watch for Women, 1.83" HD Fitness Tracker with 4 Bands, Answer/Make Calls, Heart Rate/Sleep/SpO2/Step Tracking, 100+ Sport Modes, Android/iPhone Compatible Gift (Rose Gold)

(42)
$59.99
FREE delivery Thu, Jun 19
100+ bought in past month
Loading...
Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

(980)
$39.99
FREE delivery Sun, Sep 21
300+ bought in past month
Loading...
Hand Warmers 2 Pack, 14000mAh Rechargeable Hand Warmers, Electric Hand Warmer Reusable, Portable Power Bank USB Hand Warmers 4 Levels 8 Heating, Gifts for Raynauds Ski Golf Camping

Hand Warmers 2 Pack, 14000mAh Rechargeable Hand Warmers, Electric Hand Warmer Reusable, Portable Power Bank USB Hand Warmers 4 Levels 8 Heating, Gifts for Raynauds Ski Golf Camping

(683)
$74.08$59.47
FREE delivery Jun 13 - 18
Loading...
Hand Warmers Rechargeable, 10000mAh Electric Heated Gloves Power Bank Portable Graphene Handwarmers Pouch with 3 Levels & Double-Sided Heating for Hunting Camping Golf Xmas Gifts for Women Men Kids

Hand Warmers Rechargeable, 10000mAh Electric Heated Gloves Power Bank Portable Graphene Handwarmers Pouch with 3 Levels & Double-Sided Heating for Hunting Camping Golf Xmas Gifts for Women Men Kids

(651)
$44.99
PrimeFREE delivery Sun, Jun 15
Loading...
2Pack Rechargeable Hand Warmer, 8000mAh Electric Hand Warmer Power Bank, Portable USB-C Hand Warmer for Pocket, Reusable Hand Warmer Up to 8 hrs Each, Warm Gift for Men Women, for Hunting, Camping
Amazon's Choice

2Pack Rechargeable Hand Warmer, 8000mAh Electric Hand Warmer Power Bank, Portable USB-C Hand Warmer for Pocket, Reusable Hand Warmer Up to 8 hrs Each, Warm Gift for Men Women, for Hunting, Camping

(1,128)
$15.99
FREE delivery Sat, Jun 14 on your first order
Loading...
GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

(334)
$42.99
FREE delivery Thu, Oct 16
1K+ bought in past month
Loading...
YMZ Smart Watch for Men Women, IP68 Waterproof, Bluetooth Calling, Fitness Tracker, Sleep Monitoring, 1.85'' DIY Dial, AI Built-in, 100+ Sports Modes, 7 Days Battery, Compatible with Android & iPhones

YMZ Smart Watch for Men Women, IP68 Waterproof, Bluetooth Calling, Fitness Tracker, Sleep Monitoring, 1.85'' DIY Dial, AI Built-in, 100+ Sports Modes, 7 Days Battery, Compatible with Android & iPhones

(331)
$49.99
FREE delivery Thu, Jun 19
1K+ bought in past month
Loading...
Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

(980)
$39.99
FREE delivery Sun, Sep 21
300+ bought in past month
Loading...
Smart Watch for Men Women with Bluetooth Call, Alexa Built-in, Heart Rate & Sleep Monitor, 1.83" DIY Dial Fitness Watch with 100+ Sport Modes, IP68 Waterproof, Compatible with Android iOS

Smart Watch for Men Women with Bluetooth Call, Alexa Built-in, Heart Rate & Sleep Monitor, 1.83" DIY Dial Fitness Watch with 100+ Sport Modes, IP68 Waterproof, Compatible with Android iOS

(182)
$49.99
FREE delivery Fri, Oct 31
2K+ bought in past month
Loading...
Smart Watch for Men Women with Bluetooth Call, Alexa Built-in, Heart Rate & Sleep Monitor, 1.83" DIY Dial Fitness Watch with 100+ Sport Modes, IP68 Waterproof, Compatible with Android iOS
Best Seller

Smart Watch for Men Women with Bluetooth Call, Alexa Built-in, Heart Rate & Sleep Monitor, 1.83" DIY Dial Fitness Watch with 100+ Sport Modes, IP68 Waterproof, Compatible with Android iOS

(142)
$44.99
FREE delivery Tue, Oct 21
Loading...
Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages

Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages

(24)
$206.57$200.61
FREE delivery Jun 13 - 17
Loading...
Umbra Triflora Hanging Planter for Window, Indoor Herb Garden, Set of 5, White/Black

Umbra Triflora Hanging Planter for Window, Indoor Herb Garden, Set of 5, White/Black

(7,808)
$71.52
PrimeFREE delivery Sat, Jun 14
Loading...
Large Hydroponics Growing System 14 Pods, Indoor Herb Garden with LED Grow Light, 5L Water Tank, Hydroponic Grow Kit with 3 Auto-Timers, Rotatable Light Panel and Child Lock for Home School Gardening

Large Hydroponics Growing System 14 Pods, Indoor Herb Garden with LED Grow Light, 5L Water Tank, Hydroponic Grow Kit with 3 Auto-Timers, Rotatable Light Panel and Child Lock for Home School Gardening

(119)
$167.81
FREE delivery Jun 16 - 20
Loading...
Hanging Planter Hanging Plant Holder, 6 Inch 4 Indoor Plant Pots, Wall/Window Plant Hanger Indoor Herb Garden

Hanging Planter Hanging Plant Holder, 6 Inch 4 Indoor Plant Pots, Wall/Window Plant Hanger Indoor Herb Garden

(269)
$35.99$28.90
PrimeFREE delivery Sat, Jun 14
Loading...
Ninja Air Fryer Pro 5-in-1, 5 QT Capacity, Air Fry, Bake, Roast, Reheat, and Dehydrate, Air Crisp Technology, Nonstick Basket & Crisper Plate, Grey, AF142C

Ninja Air Fryer Pro 5-in-1, 5 QT Capacity, Air Fry, Bake, Roast, Reheat, and Dehydrate, Air Crisp Technology, Nonstick Basket & Crisper Plate, Grey, AF142C

(650)
$100.99
FREE delivery Thu, Oct 16
500+ bought in past month
Loading...
Glass Oil Sprayer for Cooking, 180ml Olive Oil Sprayer Bottle with Brush, Olive Oil Spray Mister, Kitchen Gadgets Accessories for Air Fryer, Canola Oil Spritzer (GREY)

Glass Oil Sprayer for Cooking, 180ml Olive Oil Sprayer Bottle with Brush, Olive Oil Spray Mister, Kitchen Gadgets Accessories for Air Fryer, Canola Oil Spritzer (GREY)

(2,436)
$7.99
FREE delivery Mon, Jun 16 on your first order
Loading...
Hi.FANCY Portable Laptop Stand with Dual Cooling Fans for 14-17inch Laptops, Grey, 23.5 x 25.9 x 0.95cm

Hi.FANCY Portable Laptop Stand with Dual Cooling Fans for 14-17inch Laptops, Grey, 23.5 x 25.9 x 0.95cm

(0)
$36.99
FREE delivery Aug 18 - 28
Loading...
Laptop Stand for Desk, Adjustable Laptop Riser ABS+Silicone Foldable Portable Laptop Holder, Ventilated Cooling Notebook Stand for 10-15.6” Laptops,Tablet-Black

Laptop Stand for Desk, Adjustable Laptop Riser ABS+Silicone Foldable Portable Laptop Holder, Ventilated Cooling Notebook Stand for 10-15.6” Laptops,Tablet-Black

(11,679)
$14.99
FREE delivery Sat, Jun 14 on your first order
500+ bought in past month
Loading...
JETech 5 in 1 Case for Samsung Galaxy S25 Ultra 5G with 2-Pack Each Tempered Glass Screen Protector and Camera Lens Protector, Non-Yellowing Shockproof Bumper Phone Cover (Clear)

JETech 5 in 1 Case for Samsung Galaxy S25 Ultra 5G with 2-Pack Each Tempered Glass Screen Protector and Camera Lens Protector, Non-Yellowing Shockproof Bumper Phone Cover (Clear)

(197)
$15.99
FREE delivery Sat, Jun 14 on your first order
100+ bought in past month
Loading...
TAURI for iPhone 17 Pro Max Case 6.9" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

TAURI for iPhone 17 Pro Max Case 6.9" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

(0)
$10.76
FREE delivery Thu, Oct 16 on your first order
2K+ bought in past month
Loading...
TAURI for iPhone 17 Pro Case 6.3" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard
Best Seller

TAURI for iPhone 17 Pro Case 6.3" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

(61,696)
$10.76
Prime
2K+ bought in past month
Loading...
JOINPAYA 1Set Rechargeable Hand Warmer Hand Heater for Winter Heating Levels Compact

JOINPAYA 1Set Rechargeable Hand Warmer Hand Heater for Winter Heating Levels Compact

(0)
$9.29
FREE delivery Jun 20 - Jul 4
Loading...
Shakven Rechargeable Hand Warmer | Cute Comfortable Portable Hand Warmers,Ergonomic Adjustable Energy-Efficient Small Heater for Travel, Outdoor, Winter

Shakven Rechargeable Hand Warmer | Cute Comfortable Portable Hand Warmers,Ergonomic Adjustable Energy-Efficient Small Heater for Travel, Outdoor, Winter

(0)
$26.93
FREE delivery Jun 19 - Jul 2
Loading...
OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

(50)
$39.99
PrimeFREE delivery Sat, Jun 14
Loading...
OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

(649)
$39.99
PrimeFREE delivery Sat, Jun 14