AI Sleeper Agents: How Anthropic Trains and Catches Them

Video Description

In this video, we explain how Anthropic trained "sleeper agent" AIs to study deception. A "sleeper agent" is an AI model that behaves normally until it encounters a specific trigger in the prompt, at which point it awakens and executes a harmful behavior. Anthropic found that they couldn't undo the sleeper agent training using standard safety training, but they could detect sleeper agents through a simple interpretability technique. ▀▀▀▀▀▀▀▀▀SOURCES & READINGS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Sleeper agents: training deceptive LLMs that persist through safety training: - https://www.anthropic.com/research/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training - https://www.alignmentforum.org/posts/ZAsJv7xijKTfZkMtr/sleeper-agents-training-deceptive-llms-that-persist-through Simple probes can catch sleeper agents: https://www.anthropic.com/research/probes-catch-sleeper-agents Alignment Faking in Large Language Models (mentioned in passing as a more natural demonstration of deceptive alignment): https://www.anthropic.com/research/alignment-faking ▀▀▀▀▀▀▀▀▀PATREON, MEMBERSHIP, MERCH▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🟠 Patreon: https://www.patreon.com/rationalanimations 🔵 Channel membership: https://www.youtube.com/channel/UCgqt1RE0k0MIr0LoyJRy2lg/join 🟢 Merch: https://rational-animations-shop.fourthwall.com 🟤 Ko-fi, for one-time and recurring donations: https://ko-fi.com/rationalanimations ▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Rational Animations Discord: https://discord.gg/5Y3Dwz89yH Reddit: https://www.reddit.com/r/RationalAnimations/ X/Twitter: https://twitter.com/RationalAnimat1 Instagram: https://www.instagram.com/rationalanimations/ ▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ A Alcher Black Alex Hall Amir Saboury Apuis Retsam blasted0glass Bleys BlueNotesBlues bparro Chad M Jones Chris Painter Christian Loomis Colin Ricardo Craig Falls Danealor Danilo Stefani - Alessandra Erba David Piepgrass Dawson Ducky Edward Yu Ellis Jones Felix Akkermans Forodriac Origamius Fraser Cain Gabriel Ledung Glenn Tarigan Honyopenyoko Ingvi Gautsson Ivan Bachcin Jackson Emanuel James Babcock Jana JanJan Jasper L Jeroen De Dauw joe39504589 John John Everett-Slape Joshua Adrian Cahyono Juan Benet Klemen Slavic Kristin Lindquist loopuleasa Luke Freeman Martin Skalstad Steen Matthew Shinkle Michael Andregg Michael Hewitt Nathan Fish Nathan Metzger Neal Strobl NMS noggieB Odet Abadia rictic Robert Paul Schwin Scott Alexander SQRT42Pi steven michaels Stuart Alldritt Superslowmojoe Terberlo.dog Tomas Campos Tor Barstad ttw Vladimir Silyaev Fede Mathieu ronvil Michael Suazo rx Laissez Scholar BestProGaming 7ic7ac Devin King RED Rinthean Thomas Grip Boris Bend J H Richard Stambaugh Teo Val Ken Mc Alcher Black AWyattLife Torstein Haldorsen MichaÅ‚ ZieliÅ„ski ▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Directed by: Hannah Levingstone | @hannah_luloo Writers: John Burden Producer: Emanuele Ascani Art Director: Hané Harnett | @Peony_Vibes / @peonyvibes (insta) Line Producer: Kristy Steffens | https://linktr.ee/kstearb Production Managers: Jay McMichen | @Jay_TheJester Kristy Steffens | https://linktr.ee/kstearb Grey Colson | https://linktr.ee/earl.gravy Quality Assurance Lead: Lara Robinowitz | @CelestialShibe Storyboard Artists: Emmalaine Wright | @emmalainearts (insta) Hannah Levingstone | @hannah_luloo Ira Klages | @dux Lead Animators & Q/A: Ethan DeBoer | https://linktr.ee/deboer_art Lara Robinowitz | @CelestialShibe Owen Peurois | @owenpeurois Animators: Colors Giraldo | @colorsofdoom Ethan DeBoer https://linktr.ee/deboer_art Ira Klages | @dux Jay McMichen | @Jay_TheJester Jodi Kuchenbecker | @viral_genesis (insta) Jordan Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT) Keith Kavanagh | @johnnycigarettex Lara Robinowitz | @CelestialShibe Michela Biancini Owen Peurois | @owenpeurois Patrick O' Callaghan | @patrick.h264 Patrick Sholar | @Sholarscribbles Renan Kogut | @kogut_r Skylar O'Brien | @mutodaes Vaughn Oeth | @gravy_navy Zack Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT) Background Lead: Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd Asset/Background Artists: Emmalaine Wright | @emmalainearts (insta) Hané Harnett | @peonyvibes (insta) @peony_vibes (twitter) Olivia Wang | @whalesharkollie Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd Zoe Martin-Parkinson | @zoemar_son Compositing Lead: Renan Kogut | @kogut_r Compositing: Grey Colson | https://linktr.ee/earl.gravy Ira Klages | @dux Patrick O' Callaghan | @patrick.h264 Renan Kogut | @kogut_r Narrator: Rob Miles | https://www.youtube.com/c/robertmilesai VO Editor: Tony Dipiazza Original Soundtrack & Sound Design: Epic Mountain