Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang et al., 2023, Self-Consistency Improves Chain of Thought Reasoning in Language Models (The Eleventh International Conference on Learning Representations (ICLR 2023))
Subscriber deck — free during early access
1 cards in “3.3 Self-Consistency Helps When Chain-of-Thought Hurts Performance” · whole deck
3.3 Self-Consistency Helps When Chain-of-Thought Hurts Performance
- What did self-consistency do on tasks where chain-of-thought prompting hurts?On NLI and closed-book QA tasks (e.g. ANLI-R1, e-SNLI, RTE), adding rationales via chain-of-thought sometimes did worse than standard prompting, but self-consistency recovered and surpassed standard prompting, making rationales safe to add.
- Wang et al., 2023, Self-Consistency Improves Chain of Thought Reasoning in Language Models (The Eleventh International Conference on Learning Representations (ICLR 2023)), §3.3
Source
- Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery and Denny Zhou. 2023. Self-Consistency Improves Chain of Thought Reasoning in Language Models. In The Eleventh International Conference on Learning Representations (ICLR 2023). https://arxiv.org/abs/2203.11171