The Voice-First AI Overlay: Designing Conversational Co-Pilots - Gregory Bruss
AI Engineer
@aidotengineerAbout
Talks, workshops, events, and training for AI Engineers.
Video Description
This talk introduces the concept of the 'Voice-First AI Overlay': an AI agent assisting conversations directly within the communication interface, operating either single-sidedly or mediating between participants. I dive into the engineering and design of such a system. We'll cover how overlays fit into the broader agent orchestration landscape, UI principles, and address the voice-first UX problem: how to design AI overlays that genuinely assist without disrupting the primary human interaction See a live demo transforming messy, real-time captions into helpful conversational hints in the context of a language lesson.
AI Developer's Starter Kit
AI-recommended products based on this video

COOWPS Switch Case for Nintendo Switch and Switch OLED Model, Portable Full Protection Carrying Travel Bag with 18 Game Cards Storage for Switch Console Pro Controller Accessories Black

Apple iPad 11-inch: A16 chip, 11-inch Model, Liquid Retina Display, 128GB, Wi-Fi 6, 12MP Front/12MP Back Camera, Touch ID, All-Day Battery Life — Blue EPEAT

Amazon Echo Show 8 (newest model), With Spatial Audio, Smart Home Hub, and Alexa, Charcoal

FIFINE Gaming USB Microphone for PC PS5, Condenser Mic with Quick Mute, RGB Indicator, Tripod Stand, Pop Filter, Shock Mount, Gain Control for Streaming Discord Twitch Podcasts Videos- AmpliGame Global Recycled Standard

EMEET 2024 Upgraded C960 Webcam for PC, Autofocus, 1080P HD, 73° View Angle, Computer Camera w/Privacy Cover and Microphone, Plug and Play USB Webcam for Video Calling/Zoom/Teams/Google Meet

Eye Contact Web Camera for Desktop Computer – 1080P USB Camera with Microphone & Stand, Center Cam for Laptop or Desktop, Manual Focus, Plug & Play for macOS & Windows(Black)

Mini Wireless Lavalier Microphone for iPhone, iPad, Android Phone - Noise Reduction Lapel USB C Bluetooth Mic for Recording, Clip on Omni Lav Mic for Video Recording, Tiktok, YouTube, Vlog

Indestructibles: Twinkle, Twinkle, Little Star: Chew Proof · Rip Proof · Nontoxic · 100% Washable (Book for Babies, Newborn Books, Safe to Chew)

Indestructibles: Hello, Farm!: Chew Proof · Rip Proof · Nontoxic · 100% Washable (Book for Babies, Newborn Books, Safe to Chew)

Book Stand for Reading, Adjustable Book Holder with 360° Rotating Bases, Foldable Designs, and Elastic Clips, Multifunctional Display Stand for Recipe, Cookbooks, Magazines, Tablets, Laptops

Megoo 14" Laptop Sleeve Case for Surface Laptop 7/6/5/4/Studio, Surface Book, Samsung Galaxy Tab S9/S8, Shockproof Water-Resistant Carry Pouch Bag for 13.5"-14.6" Notebook Computers(Light Gray)

DAYBETTER LED Strip Lights 130ft Lights Strip for Bedroom, Desk, Indoor Room Bedroom Brithday Gifts RGB Decor with Remote and 24V Power Supply

Redragon RGPS-850W 80+ Gold 850 Watt ATX 3.0 & PCIe 5.0 Fully Modular Power Supply w/ 80 Plus Gold Certified, Compact 160mm Size, Smart ECO Low Noise RGB Fan, 100% Japanese Capacitors, Full Mod Cables

Roku Streaming Stick Plus 2025 - 4K & HDR Roku Streaming Device for TV with Voice Remote - Free & Live TV

Roku Streaming Stick HD 2025 — HD Streaming Device for TV with Roku Voice Remote, Free & Live TV

NOCO Boost GB40: 1000A UltraSafe Jump Starter – 12V Lithium Battery Booster Pack, Portable Jump Box, Power Bank & Jumper Cables - for 6.0L Gas and 3.0L Diesel Engines

UGREEN Revodok Pro 210 Docking Station 10 in 1 USB C Dock Dual HDMI 4K@60Hz Single 8K@30Hz 100W PD 5Gbps USB C and USB A Data Ports Gigabit Ethernet, SD/TF Card Reader USB Hub Compatible for HP, Dell

UGREEN USB C to USB Hub with 4 USB 3.0, Powered USB C Splitter for Laptop, MacBook Pro, Mac mini M4, iMac, iPad Pro, Chromebook, Dell XPS, Galaxy S23, and More, 0.5FT

UGREEN USB C Hub 10Gbps, 4 Ports USB 3.2 HUB with 2 USB-C 3.2 and 2 USB-A 3.2, USB Port Extender for MacBook Pro, MacBook Air, Acer Aspire, HP Laptops, iPad Pro, iPhone 15/15 Pro Max and More




