A Watermark for Large Language Models
Kirchenbauer et al., 2023, A Watermark for Large Language Models (Proceedings of the 40th International Conference on Machine Learning (ICML 2023), PMLR 202)
Subscriber deck — free during early access
1 cards in “3.1 Detecting the soft watermark” · whole deck
3.1 Detecting the soft watermark
- How does detection sensitivity of the soft watermark depend on the text?Detection uses the same z-test, but the green-token excess depends on entropy: high-entropy text is detected from few tokens, while low-entropy text (often memorized or near-copied human text) needs many tokens or isn’t detectable at all.
- Kirchenbauer et al., 2023, A Watermark for Large Language Models (Proceedings of the 40th International Conference on Machine Learning (ICML 2023), PMLR 202), §3.1
Source
- John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers and Tom Goldstein. 2023. A Watermark for Large Language Models. In Proceedings of the 40th International Conference on Machine Learning (ICML 2023), PMLR 202, pp. 17061–17084. https://proceedings.mlr.press/v202/kirchenbauer23a.html