learn.ifs.name

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Shao et al., 2024, DeepSeekMath (arXiv preprint arXiv:2402.03300)

Subscriber deck — free during early access

1 cards in “5.1.1 Code Training Benefits Mathematical Reasoning” · whole deck

5.1.1 Code Training Benefits Mathematical Reasoning

  1. What did DeepSeekMath find about code training and arXiv papers?
    Code training before math training improved mathematical problem solving both with and without tools, partly answering whether code helps reasoning; arXiv papers, despite their popularity in math corpora, brought no notable improvement on the benchmarks tested.
    • Shao et al., 2024, DeepSeekMath (arXiv preprint arXiv:2402.03300), §5.1.1

Source

  • Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, Y. K. Li, Y. Wu and Daya Guo. 2024. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models. In arXiv preprint arXiv:2402.03300. https://arxiv.org/abs/2402.03300