This Changes Games Forever: AI That Builds and Plays in 3D Worlds

Video Description

AI can now generate full 3D worlds from just an image — and Google DeepMind's newest AI agent, SIMA 2, can move through them, explore, and even play games inside these environments. This video breaks down how world-generation models like World Lab's Marble and agentic systems like SIMA 2 are converging to reshape simulation, filmmaking, game development, and interactive AI. Looking ahead, this fusion of world models and AI agents hints at a future where digital environments are built on demand, characters think and act autonomously, and entire experiences can be generated, tested, and explored in real time — blurring the line between virtual and physical worlds. World Labs Marble - https://www.worldlabs.ai/ Google DeepMind's SIMA 2 - https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/ Chapters: 0:00 – Building a World With AI (World Labs Marble) 1:15 – Multi-Image Input) 2:10 – Using Panoramas as 3D Inputs 3:20 – Editing Worlds: Inpainting and Object Removal 5:44 – Chisel: 3D Blocking Inputs 6:33 – Video to Video Outputs 7:13 – Exporting to 3D Software 8:45 – Real-World Use Cases (Games, XR, VP) 11:55 – Google’s New AI Agent (SIMA 2) 15:29 – The Implicit Approach (Genie-3 & Diffusion-based World Models) 16:00 – Why We Need World Models 17:03 – Motion Stream (Video Diffusion & Control) 17:48 – Where This All Goes Next -- Subscribe for more in-depth AI & creative tech videos! 👉 ‪@bilawalsidhu‬ Join My Newsletter: https://spatialintelligence.ai Connect with me on X/Twitter here: https://x.com/bilawalsidhu Everywhere else here: https://bilawal.ai Business inquiries: [email protected] Bio: Bilawal Sidhu is a creator, engineer, and product builder obsessed with blending reality and imagination using art and science. Bilawal is the technology curator for TED Talks, and a venture scout for Andreessen Horowitz. With more than a decade of experience in the tech industry, he spent six years as a product manager at Google, where he worked on spatial computing and 3D maps. His work has been featured in major publications including Bloomberg, Forbes, BBC, CNBC, and Fortune, among others. Bilawal’s journey into computer graphics began at 11, when he fell in love with seamlessly blending 3D into real life footage. Since then, he's captivated over 1.5M subscribers, garnering more than 500M+ views across his platforms. Driven by a mission to empower the next generation of artists and entrepreneurs, Bilawal openly shares AI-assisted workflows and industry insights on social media. When he’s not working, you can find Bilawal expanding his collection of electric guitars. TED: https://www.ted.com/speakers/bilawal_sidhu