Google Lumiere AI: Space-Time Video Diffusion Explained!

Bilawal Sidhu February 2, 2024
Video Thumbnail
Bilawal Sidhu Logo

Bilawal Sidhu

@bilawalsidhu

About

Deep Dives on AI, AR/VR, and robotics — mapping the breakthroughs, blind spots, and reality-bending technologies that are reshaping our world. This channel is your atlas to what's next in creation and computing, breaking down complex topics with a balance of creative optimism, technical depth, and strategic foresight. About Bilawal Sidhu: Blending reality & imagination. Mapped the world at Google. Now mapping the future of creation & computing. TED Curator. A16z Scout. Creative technologist with 1.5M+ subscribers and 500M+ views across platforms. Started with VFX at 11. Went from VFX Artist → Software Engineer → Product Designer → Product Manager → Creator. Shaping the next generation of creators & builders wielding equal parts technology & artistry. Perpetually expanding my collection of electric guitars. To get in touch, please use the email below, or connect on social media.

Video Description

Google AI dropped LUMIERE. Say hello to "space-time diffusion" for video generation! It's remarkably flexible, supporting video inpainting, image-to-video, AND video stylization tasks. Now what the heck does that mean exactly?! Let's dive in 🌐⏳ Video Chapters: 00:00 Google Lumiere 00:28 Space-Time Diffusion 01:16 1) Video-to-Video 01:48 2) Text-to-Video 02:22 3) Image-to-Video 02:43 4) Stylized Generation 03:46 5) Cinemagraphs 04:20 6) Video Inpainting 04:56 Lumiere vs. Pika, Runway, SVD 05:25 YouTube AI Creator Tools AI research papers featured in this video: 🔗Paper: https://arxiv.org/abs/2401.12945 🔗Project: https://lumiere-video.github.io/ref Connect on socials: - Twitter/X: https://twitter.com/bilawalsidhu - Creative tech digest (blog/newsletter): https://creativetech.beehiiv.com/ - Other links: https://beacons.ai/billyfx #ai #google #generativeai #pikalabs #runwayml #googleai #ml

You May Also Like

Essential AI & Video Tools

AI-recommended products based on this video

Loading...
MSI Thin 15 Gaming Laptop, 15.6" 144 Hz IPS Display, AMD Ryzen 9 8945HS, NVIDIA RTX 4060 8GB GDDR6, 32 GB DDR5, 2 TB SSD, with Windows 11 Pro, Office Pro Lifetime License, Mouse, USB C Flash Drive

MSI Thin 15 Gaming Laptop, 15.6" 144 Hz IPS Display, AMD Ryzen 9 8945HS, NVIDIA RTX 4060 8GB GDDR6, 32 GB DDR5, 2 TB SSD, with Windows 11 Pro, Office Pro Lifetime License, Mouse, USB C Flash Drive

(2,122)
1,559.99
FREE delivery Wednesday, June 11.
Loading...
Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

(14)
Loading...
acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

(827)
$1,659.99
FREE delivery Jun 17 - 20
Loading...
acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

(348)
$1,579.99
FREE delivery Jun 17 - 20
Loading...
Lenovo 15.6" Laptop, Intel 10-Core i7-13620H (Beat Ultra 7 255U), 40GB DDR4 RAM, 2TB PCIe SSD, WiFi 6, Bluetooth 5.2, FHD Computer for Business & Student, RJ45, Type-C, HDMI, Windows 11 Pro, Wendbo

Lenovo 15.6" Laptop, Intel 10-Core i7-13620H (Beat Ultra 7 255U), 40GB DDR4 RAM, 2TB PCIe SSD, WiFi 6, Bluetooth 5.2, FHD Computer for Business & Student, RJ45, Type-C, HDMI, Windows 11 Pro, Wendbo

(11)
$899.00
FREE delivery Jun 18 - 23
Loading...
Lenovo Ideapad Laptop, 15.6" Touchscreen FHD Computer, Intel 10-Core i5-1235U (Beat i7-1195G7), 40GB DDR4 RAM, 2TB PCIe SSD, WiFi 6, Type-C, HDMI, Abyss Blue, Windows 11 Pro S, BEF-ectoy Cable

Lenovo Ideapad Laptop, 15.6" Touchscreen FHD Computer, Intel 10-Core i5-1235U (Beat i7-1195G7), 40GB DDR4 RAM, 2TB PCIe SSD, WiFi 6, Type-C, HDMI, Abyss Blue, Windows 11 Pro S, BEF-ectoy Cable

(11)
$699.99
FREE delivery Jun 17 - 20
Loading...
Lenovo ThinkPad E16 Business Laptop, 16" FHD+ Touchscreen, Intel i7-1355U, 40GB RAM, 1TB SSD, AI Copilot, Fingerprint, Backlit KB, HDMI, Wi-Fi 6, Windows 11 Pro, Bundle with UC310 64GB USB Flash Drive

Lenovo ThinkPad E16 Business Laptop, 16" FHD+ Touchscreen, Intel i7-1355U, 40GB RAM, 1TB SSD, AI Copilot, Fingerprint, Backlit KB, HDMI, Wi-Fi 6, Windows 11 Pro, Bundle with UC310 64GB USB Flash Drive

(1)
$996.55
FREE delivery Jun 18 - 23
50+ bought in past month
Loading...
UGREEN Uno 6 in 1 USB-C Hub with 10Gbps USB-C & USB-A Data Ports 4K@60Hz HDMI for MacBook Pro/Air, iPad Pro, Surface, XPS, Thinkpad and More.

UGREEN Uno 6 in 1 USB-C Hub with 10Gbps USB-C & USB-A Data Ports 4K@60Hz HDMI for MacBook Pro/Air, iPad Pro, Surface, XPS, Thinkpad and More.

(1,196)
22.49
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
100+ bought in past month
Loading...
Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified
Best Seller

Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified

(16,688)
$9.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard
Best Seller

Car Phone Holder for Magsafe [78+LBS Strongest Suction & 2400gf Magnetic] 360° Adjustable Car Phone Mount, Phone Holders for Your Car for iPhone 17 Pro Max 16 15 14 13 12 Air Plus (Carbon Fiber) Global Recycled Standard

(10,765)
$26.99$26.45
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25
Best Seller

LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25

(10,850)
$16.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | 8-Core AMD Ryzen 7-5700U | AMD Radeon | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | 8-Core AMD Ryzen 7-5700U | AMD Radeon | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

(3)
$979.99$739.99
FREE delivery Jun 18 - 23
Loading...
acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | AMD Radeon | 8-Core AMD Ryzen 7-5700U | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | AMD Radeon | 8-Core AMD Ryzen 7-5700U | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

(14)
$979.99$739.99
FREE delivery Jun 18 - 23
Loading...
Lexar ES3 1TB External SSD, USB 3.2 Gen2 Portable SSD, PSSD Up to 1050MB/s Read, 1000MB/s Write, External Solid State Drive Compatible with iPhone 16/15 Series/Mac/PS5/XBOX/Laptop/PC

Lexar ES3 1TB External SSD, USB 3.2 Gen2 Portable SSD, PSSD Up to 1050MB/s Read, 1000MB/s Write, External Solid State Drive Compatible with iPhone 16/15 Series/Mac/PS5/XBOX/Laptop/PC

(37)
69.99
PrimeFREE delivery Saturday, June 14
300+ bought in past month
Loading...
Selfie Stick Travel Tripod for Cell Phone with Remote Control and Phone Holder, Extendable Selfie Stick for iPhone, iPhone Tripod for Video Recording, 50 Inch, Black

Selfie Stick Travel Tripod for Cell Phone with Remote Control and Phone Holder, Extendable Selfie Stick for iPhone, iPhone Tripod for Video Recording, 50 Inch, Black

(3,610)
$9.99
FREE delivery Fri, Nov 14 on $35 of items shipped by Amazon
10K+ bought in past month