s1: Simple test-time scaling
Muennighoff et al., 2025, s1 (Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing)
Subscriber deck — free during early access
1 cards in “3.1 Method” · whole deck
3.1 Method
- What is budget forcing?A decoding-time control of thinking length. To cap it, the end-of-thinking delimiter (optionally with “Final Answer:”) is appended once the budget is used, forcing an answer. To extend it, the end-of-thinking delimiter is suppressed and “Wait” is appended, which often makes the model re-check and fix its answer.
Budget forcing lengthens or shortens thinking at decoding time - Muennighoff et al., 2025, s1 (Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing), §3.1, p. 20278
Source
- Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès and Tatsunori Hashimoto. 2025. s1: Simple test-time scaling. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pp. 20275–20321. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/2025.emnlp-main.1025 https://aclanthology.org/2025.emnlp-main.1025/