π΄ Letβs build an AI Voice Assistant App with NEXT.JS 14! (Azure, OpenAI, Whisper Speech AI)
Sonny Sangha
@sonnysanghaAbout
I'm Sonny. π― You might also know me as PAPA React! I've been coding for over 10 years now. As a Full Stack developer I've worked both with startups and large corporations to help build & scale their companies. Along the journey I realised my passion existed in helping others excel and pursue their dreams as upcoming developers and if thatβs not enough I have cloned most of the applications you have used in your life! π π¨ Join the worldβs BEST developer community βZero to Full Stack Heroβ NOW: https://www.papareact.com/course
Latest Posts
Video Description
βοΈ Get the Code for FREE here (Form must be submitted, not skipped!): https://aka.ms/sonnyai π¨ Join the worldβs BEST developer community & course Zero to Full Stack Hero: https://www.papareact.com/course π« Join my Community, "University of Code" for FREE: https://www.universityofcode.com π΄ Looking for the code for my other builds? π οΈ https://links.papareact.com/github Join me as I show you how to build it from scratch with the newly released Next.js 14. You'll learn the following in this build: π Create a Beautiful UI & UX for our Siri 2.0 clone! π How to use the Azure OpenAI Whisper Speech Recognition Service to convert speech to text! π How to create and leverage the power of Azure OpenAI Service to generate AI Assistant Chat Completions at scale! π How to use the MediaRecorder interface of the MediaStream Recording API to capture user audio! π Use the Web Speech API interface to synthesise an artificial voice to output the AI Assistant replies! π How to build a beautiful UI design with Tailwind CSS! π How to use TypeScript to reduce the overall number of Bugs and Errors π How to deploy the final build on Vercel! π΅ WANT TO LISTEN TO THE EXCLUSIVE PAPAFAM PLAYLIST? Sign up for the PAPAFAM Newsletter here π https://links.papareact.com/newsletter π TIMESTAMPS: 00:00 Introduction 01:04 Build Demo 04:26 Build Tech 06:24 Build Plan 10:38 Initialising the Build 15:15 Build Layout 16:02 Building the Header Section (1/2) 18:53 Implementing Shadcn/ui 21:35 Building the Header Section (2/2) 25:13 Building the Form Section 30:08 Building the Messages Section in Form 31:46 Building the Recorder Section in Form 32:53 Creating the Messages Component 35:33 Building the Recorder Component 39:24 Building the Hidden Fields Section in Form 42:15 Implementing Functionality to Capture Audio 48:19 Implementing the MediaRecorder Interface 58:41 Implementing the Start & Stop Recording Functionality 1:15:53 Implementing Next.js 14 Server Actions (1/2) 1:17:20 Setting Up Microsoft Azure OpenAI Service 1:20:44 Implementing Microsoft Azure OpenAI Service 1:24:06 Implementing the Whisper API Model 1:28:15 Implementing Next.js 14 Server Actions (2/2) 1:44:18 Building the Messages Component (1/2) 1:53:02 Implementing a Message Loader 1:55:57 Implementing the Voice Synthesizer Functionality with Web Speech API 2:15:30 Building the Messages Component (2/2) 2:18:50 Deploying to Vercel 2:30:59 Final Build Demo 2:33:36 Outro Letβs get it PAPAFAM π₯. DISCLAIMER: This Video is made for informational and educational purposes only. We do not own or affiliate with Siri, Apple and/or any of its subsidiaries in any form. Copyright Disclaimer Under section 107 of the Copyright Act 1976, allowance is made for βfair useβ of this video for education purposes. #nextjs #nextjs14 #react #siri #voiceassistant #typescript #reactjs #openai #coding #javascript #tailwindcss #shadcn #nosql #reactjstutorial #coding #tutorial #beginner #programming #ai #apple #voicerecognition #machinelearning
Upgrade Your iPhone Experience
AI-recommended products based on this video
![iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White](https://m.media-amazon.com/images/I/61i3XjcGu1L._AC_SL1500_.jpg)
iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

Kaistyle for Magsafe Car Mountγ20 Strong Magnetsγ Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified
![Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard](https://m.media-amazon.com/images/I/712lUnThXpL._AC_UL960_FMwebp_QL65_.jpg)
Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard

LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25
![Apple Watch Series 10 [GPS 46mm case] Smartwatch with Rose Gold Aluminium Case with Light Blush Sport Band - M/L. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant](https://m.media-amazon.com/images/I/61nNNMI1cFL._AC_UL960_FMwebp_QL65_.jpg)
Apple Watch Series 10 [GPS 46mm case] Smartwatch with Rose Gold Aluminium Case with Light Blush Sport Band - M/L. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant
![Apple Watch Series 10 [GPS 42mm case] Smartwatch with Jet Black Aluminium Case with Black Sport Band - S/M. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant](https://m.media-amazon.com/images/I/6105jZyXyPL._AC_UL960_FMwebp_QL65_.jpg)
Apple Watch Series 10 [GPS 42mm case] Smartwatch with Jet Black Aluminium Case with Black Sport Band - S/M. Fitness Tracker, ECG App, Always-On Retina Display, Water Resistant

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone

Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and OutputοΌBlackοΌοΌ1pack) ClimatePartner certified

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified
![Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard](https://m.media-amazon.com/images/I/712lUnThXpL._AC_UL960_FMwebp_QL65_.jpg)
Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360Β° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard

Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and OutputοΌBlackοΌοΌ1pack) ClimatePartner certified

FNTCASE for iPhone 17 Pro-Max Case: Clear Magnetic Phone Cases with Screen Protector Compatible with Magsafe Slim Anti Yellowing Rugged Shockproof Protective Transparent Cell Cover (A-Clear) Recycled Claim Standard Blended

Apple AirPods Pro 2 Wireless Earbuds, Active Noise Cancellation, Hearing Aid Feature, Bluetooth Headphones, Transparency, Personalized Spatial Audio, High-Fidelity Sound, H2 Chip, USB-C Charging

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

ESR 3 Pack for iPhone 16e/ iPhone 14/ iPhone 13/ iPhone 13 Pro Privacy Screen Protector, Anti-spy Tempered-Glass Privacy Screen Protector, Micro-curved Edges, Case Friendly
![iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White](https://m.media-amazon.com/images/I/61i3XjcGu1L._AC_SL1500_.jpg)
iPhone Charger Cord [MFi Certified] 3Pack 0.9M Lighting Cable Power Delivery Charging Cord Compatible with iPhone 14 13 13 Pro Max 12 12 Pro Max 11 XS XR X 8 iPad,White

2 Pack Professional Wireless Lavalier Microphone for iPhone iPad(iPhone 14 and Below), Lapel Mics Plug-Play Clip on Lapel Mic for YouTube, Recording, Vlog, Facebook Live

VOLTME Portable Charger, Slim 10000mAh 5V/3A Power Bank, USB C in&Out High-Speed Charging Battery Pack, Travel Essentials Dual Output Compatible with iPhone 16 15 14 13 12 Samsung Google iPad etc














