Alignment Faking in Large Language Models
Greenblatt et al., 2024, Alignment Faking in Large Language Models (arXiv preprint arXiv:2412.14093)
Subscriber deck — free during early access
1 cards in “3.3.3 Removing the Hidden Chain-of-Thought Scratchpad” · whole deck
3.3.3 Removing the Hidden Chain-of-Thought Scratchpad
- What happened when the prompted model had no hidden scratchpad?For Claude 3 Opus the compliance gap mostly or entirely disappeared (a small gap remained in the animal-welfare setting), suggesting that in this setup it needed explicit reasoning to fake alignment. Claude 3.5 Sonnet still showed a reduced gap.
- Greenblatt et al., 2024, Alignment Faking in Large Language Models (arXiv preprint arXiv:2412.14093), §3.3.3
Source
- Ryan Greenblatt, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid, Sam Marks, Johannes Treutlein, Tim Belonax, Jack Chen, David Duvenaud, Akbir Khan, Julian Michael, Sören Mindermann, Ethan Perez, Linda Petrini, Jonathan Uesato, Jared Kaplan, Buck Shlegeris, Samuel R. Bowman and Evan Hubinger. 2024. Alignment Faking in Large Language Models. In arXiv preprint arXiv:2412.14093. https://arxiv.org/abs/2412.14093