πŸ”΄ Let’s build an AI Voice Assistant App with NEXT.JS 14! (Azure, OpenAI, Whisper Speech AI)

Sonny Sangha β€’ March 17, 2024
Video Thumbnail
Sonny Sangha Logo

Sonny Sangha

@sonnysangha

About

I'm Sonny. πŸ’― You might also know me as PAPA React! I've been coding for over 10 years now. As a Full Stack developer I've worked both with startups and large corporations to help build & scale their companies. Along the journey I realised my passion existed in helping others excel and pursue their dreams as upcoming developers and if that’s not enough I have cloned most of the applications you have used in your life! 🌟 🚨 Join the world’s BEST developer community β€œZero to Full Stack Hero” NOW: https://www.papareact.com/course

Video Description

❗️ Get the Code for FREE here (Form must be submitted, not skipped!): https://aka.ms/sonnyai 🚨 Join the world’s BEST developer community & course Zero to Full Stack Hero: https://www.papareact.com/course πŸ«‚ Join my Community, "University of Code" for FREE: https://www.universityofcode.com πŸ”΄ Looking for the code for my other builds? πŸ› οΈ https://links.papareact.com/github Join me as I show you how to build it from scratch with the newly released Next.js 14. You'll learn the following in this build: πŸ‘‰ Create a Beautiful UI & UX for our Siri 2.0 clone! πŸ‘‰ How to use the Azure OpenAI Whisper Speech Recognition Service to convert speech to text! πŸ‘‰ How to create and leverage the power of Azure OpenAI Service to generate AI Assistant Chat Completions at scale! πŸ‘‰ How to use the MediaRecorder interface of the MediaStream Recording API to capture user audio! πŸ‘‰ Use the Web Speech API interface to synthesise an artificial voice to output the AI Assistant replies! πŸ‘‰ How to build a beautiful UI design with Tailwind CSS! πŸ‘‰ How to use TypeScript to reduce the overall number of Bugs and Errors πŸ‘‰ How to deploy the final build on Vercel! 🎡 WANT TO LISTEN TO THE EXCLUSIVE PAPAFAM PLAYLIST? Sign up for the PAPAFAM Newsletter here πŸ‘‰ https://links.papareact.com/newsletter πŸ• TIMESTAMPS: 00:00 Introduction 01:04 Build Demo 04:26 Build Tech 06:24 Build Plan 10:38 Initialising the Build 15:15 Build Layout 16:02 Building the Header Section (1/2) 18:53 Implementing Shadcn/ui 21:35 Building the Header Section (2/2) 25:13 Building the Form Section 30:08 Building the Messages Section in Form 31:46 Building the Recorder Section in Form 32:53 Creating the Messages Component 35:33 Building the Recorder Component 39:24 Building the Hidden Fields Section in Form 42:15 Implementing Functionality to Capture Audio 48:19 Implementing the MediaRecorder Interface 58:41 Implementing the Start & Stop Recording Functionality 1:15:53 Implementing Next.js 14 Server Actions (1/2) 1:17:20 Setting Up Microsoft Azure OpenAI Service 1:20:44 Implementing Microsoft Azure OpenAI Service 1:24:06 Implementing the Whisper API Model 1:28:15 Implementing Next.js 14 Server Actions (2/2) 1:44:18 Building the Messages Component (1/2) 1:53:02 Implementing a Message Loader 1:55:57 Implementing the Voice Synthesizer Functionality with Web Speech API 2:15:30 Building the Messages Component (2/2) 2:18:50 Deploying to Vercel 2:30:59 Final Build Demo 2:33:36 Outro Let’s get it PAPAFAM πŸ”₯. DISCLAIMER: This Video is made for informational and educational purposes only. We do not own or affiliate with Siri, Apple and/or any of its subsidiaries in any form. Copyright Disclaimer Under section 107 of the Copyright Act 1976, allowance is made for β€œfair use” of this video for education purposes. #nextjs #nextjs14 #react #siri #voiceassistant #typescript #reactjs #openai #coding #javascript #tailwindcss #shadcn #nosql #reactjstutorial #coding #tutorial #beginner #programming #ai #apple #voicerecognition #machinelearning

You May Also Like

Upgrade Your iPhone Experience

AI-recommended products based on this video

Loading...
iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

(4,813)
7.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
Loading...
Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified
Best Seller

Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified

(16,688)
$9.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard
Best Seller

Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard

(10,765)
$26.99$26.45
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25
Best Seller

LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25

(10,850)
$16.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Apple Watch Series 10 [GPS 46mm case] Smartwatch with Rose Gold Aluminium Case with Light Blush Sport Band - M/L. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant
Best Seller

Apple Watch Series 10 [GPS 46mm case] Smartwatch with Rose Gold Aluminium Case with Light Blush Sport Band - M/L. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant

(7,994)
$329.00$296.10
FREE delivery Thu, Jul 3
1K+ bought in past month
Loading...
Apple Watch Series 10 [GPS 42mm case] Smartwatch with Jet Black Aluminium Case with Black Sport Band - S/M. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant
Best Seller

Apple Watch Series 10 [GPS 42mm case] Smartwatch with Jet Black Aluminium Case with Black Sport Band - S/M. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant

(7,993)
$299.00$269.10
FREE delivery Thu, Jul 3
8K+ bought in past month
Loading...
Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip
Best Seller

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip

(26,751)
$118.98$114.22
FREE delivery Fri, Oct 17
10K+ bought in past month
Loading...
Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone
Best Seller

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone

(23,152)
$89.99$83.69
FREE delivery Thu, Sep 4
10K+ bought in past month
Loading...
Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and Output(BlackοΌ‰οΌŒ1pack) ClimatePartner certified

Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and Output(BlackοΌ‰οΌŒ1pack) ClimatePartner certified

(109,961)
$17.99$17.81
FREE delivery Fri, Aug 8 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified
Best Seller

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified

(44,096)
$8.49
FREE delivery Thu, Jul 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard
Best Seller

Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard

(10,765)
$26.99$26.45
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and Output(BlackοΌ‰οΌŒ1pack) ClimatePartner certified

Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and Output(BlackοΌ‰οΌŒ1pack) ClimatePartner certified

(109,961)
$17.99$17.81
FREE delivery Fri, Aug 8 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
FNTCASE for iPhone 17 Pro-Max Case: Clear Magnetic Phone Cases with Screen Protector Compatible with Magsafe Slim Anti Yellowing Rugged Shockproof Protective Transparent Cell Cover (A-Clear) Recycled Claim Standard Blended

FNTCASE for iPhone 17 Pro-Max Case: Clear Magnetic Phone Cases with Screen Protector Compatible with Magsafe Slim Anti Yellowing Rugged Shockproof Protective Transparent Cell Cover (A-Clear) Recycled Claim Standard Blended

(0)
$3.95
FREE delivery Wed, Nov 19 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Apple AirPods Pro 2 Wireless Earbuds, Active Noise Cancellation, Hearing Aid Feature, Bluetooth Headphones, Transparency, Personalized Spatial Audio, High-Fidelity Sound, H2 Chip, USB-C Charging

Apple AirPods Pro 2 Wireless Earbuds, Active Noise Cancellation, Hearing Aid Feature, Bluetooth Headphones, Transparency, Personalized Spatial Audio, High-Fidelity Sound, H2 Chip, USB-C Charging

(38,487)
$199.00$187.32
FREE delivery Fri, Oct 3
10K+ bought in past month
Loading...
Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified
Best Seller

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified

(44,096)
$8.49
FREE delivery Thu, Jul 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

(16,565)
13.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
10K+ bought in past month
Loading...
ESR 3 Pack for iPhone 16e/ iPhone 14/ iPhone 13/ iPhone 13 Pro Privacy Screen Protector, Anti-spy Tempered-Glass Privacy Screen Protector, Micro-curved Edges, Case Friendly

ESR 3 Pack for iPhone 16e/ iPhone 14/ iPhone 13/ iPhone 13 Pro Privacy Screen Protector, Anti-spy Tempered-Glass Privacy Screen Protector, Micro-curved Edges, Case Friendly

(5,773)
9.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
1K+ bought in past month
Loading...
iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

(4,813)
7.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
Loading...
2 Pack Professional Wireless Lavalier Microphone for iPhone iPad(iPhone 14 and Below), Lapel Mics Plug-Play Clip on Lapel Mic for YouTube, Recording, Vlog, Facebook Live

2 Pack Professional Wireless Lavalier Microphone for iPhone iPad(iPhone 14 and Below), Lapel Mics Plug-Play Clip on Lapel Mic for YouTube, Recording, Vlog, Facebook Live

(2,012)
$12.99
FREE delivery Fri, Oct 10 on $35 of items shipped by Amazon
50+ bought in past month
Loading...
VOLTME Portable Charger, Slim 10000mAh 5V/3A Power Bank, USB C in&Out High-Speed Charging Battery Pack, Travel Essentials Dual Output Compatible with iPhone 16 15 14 13 12 Samsung Google iPad etc

VOLTME Portable Charger, Slim 10000mAh 5V/3A Power Bank, USB C in&Out High-Speed Charging Battery Pack, Travel Essentials Dual Output Compatible with iPhone 16 15 14 13 12 Samsung Google iPad etc

(51)
19.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
Loading...
ESR 3 Pack for iPhone 16e/ iPhone 14/ iPhone 13/ iPhone 13 Pro Privacy Screen Protector, Anti-spy Tempered-Glass Privacy Screen Protector, Micro-curved Edges, Case Friendly

ESR 3 Pack for iPhone 16e/ iPhone 14/ iPhone 13/ iPhone 13 Pro Privacy Screen Protector, Anti-spy Tempered-Glass Privacy Screen Protector, Micro-curved Edges, Case Friendly

(5,773)
9.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
1K+ bought in past month