LIMA: Less Is More for Alignment
Zhou et al., 2023, LIMA (Advances in Neural Information Processing Systems 36 (NeurIPS 2023))
Subscriber deck — free during early access
2 cards in “2.1 Community Questions & Answers” · whole deck
2.1 Community Questions & Answers
- How did Zhou et al. select Stack Exchange examples for LIMA?200 from STEM and 200 from other exchanges, sampled with temperature to balance domains; top-scoring questions answerable from the title; the top answer (score at least 10); answers filtered by length (1,200–4,096 characters) and for first-person or references to other answers, with links and images removed.
- Zhou et al., 2023, LIMA (Advances in Neural Information Processing Systems 36 (NeurIPS 2023)), §2.1
- Why was Reddit used differently from Stack Exchange and wikiHow?Highly upvoted Reddit answers are often witty or trolling rather than helpful, so examples were picked by hand: 150 r/WritingPrompts stories for training, and r/AskReddit prompts only for the test set.
- Zhou et al., 2023, LIMA (Advances in Neural Information Processing Systems 36 (NeurIPS 2023)), §2.1
Source
- Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis and Omer Levy. 2023. LIMA: Less Is More for Alignment. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). https://papers.nips.cc/paper_files/paper/2023/hash/ac662d74829e4407ce1d126477f4a03a-Abstract-Conference.html