Large Language Diffusion Models
Nie et al., 2025, Large Language Diffusion Models (Advances in Neural Information Processing Systems 38 (NeurIPS 2025))
Subscriber deck — free during early access
1 cards in “3.2 Benchmark Results” · whole deck
3.2 Benchmark Results
- How did LLaDA 8B compare with LLaMA models?The base model beat LLaMA2 7B on nearly all 15 zero/few-shot tasks and was overall competitive with LLaMA3 8B, stronger in math and Chinese. After SFT alone (no RL alignment) it trailed LLaMA3 8B Instruct slightly but followed instructions and held multi-turn conversations.
- Nie et al., 2025, Large Language Diffusion Models (Advances in Neural Information Processing Systems 38 (NeurIPS 2025)), §3.2
Source
- Shen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang, Jingyang Ou, Jun Hu, Jun Zhou, Yankai Lin, Ji-Rong Wen and Chongxuan Li. 2025. Large Language Diffusion Models. In Advances in Neural Information Processing Systems 38 (NeurIPS 2025). https://arxiv.org/abs/2502.09992