Large Language Diffusion Models

Nie et al., 2025, Large Language Diffusion Models (Advances in Neural Information Processing Systems 38 (NeurIPS 2025))

Subscriber deck — free during early access

1 cards in “3.3 Reversal Reasoning and Analyses” · whole deck

3.3 Reversal Reasoning and Analyses

How did LLaDA fare on the reversal curse test?
On 496 Chinese poem line pairs, it scored about the same forward (51.8%) and backward (45.6%). GPT-4o (82.7% vs 34.3%) and Qwen2.5-7B (75.9% vs 38.0%) were much stronger forward but fell far behind it in reverse, because LLaDA treats all positions alike.
- Nie et al., 2025, Large Language Diffusion Models (Advances in Neural Information Processing Systems 38 (NeurIPS 2025)), §3.3

Source

Shen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang, Jingyang Ou, Jun Hu, Jun Zhou, Yankai Lin, Ji-Rong Wen and Chongxuan Li. 2025. Large Language Diffusion Models. In Advances in Neural Information Processing Systems 38 (NeurIPS 2025). https://arxiv.org/abs/2502.09992