LIMA: Less Is More for Alignment

Zhou et al., 2023, LIMA (Advances in Neural Information Processing Systems 36 (NeurIPS 2023))

Subscriber deck — free during early access

1 cards in “4.3 Analysis” · whole deck

4.3 Analysis

What did the absolute analysis of LIMA’s responses show?
Of 50 random test prompts, 50% of responses were excellent and only 6 failed to meet the prompt’s requirements; on out-of-distribution prompts (formats absent from training) the results were similar: 45% excellent, 35% pass, 20% fail.
- Zhou et al., 2023, LIMA (Advances in Neural Information Processing Systems 36 (NeurIPS 2023)), §4.3

Source

Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis and Omer Levy. 2023. LIMA: Less Is More for Alignment. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). https://papers.nips.cc/paper_files/paper/2023/hash/ac662d74829e4407ce1d126477f4a03a-Abstract-Conference.html