learn.ifs.name

LLaMA: Open and Efficient Foundation Language Models

Touvron et al., 2023, LLaMA (arXiv preprint arXiv:2302.13971)

Subscriber deck — free during early access

1 cards in “3.1 Common Sense Reasoning” · whole deck

3.1 Common Sense Reasoning

  1. How did LLaMA compare with larger models on zero-shot common sense benchmarks?
    LLaMA-65B beat Chinchilla-70B on all eight benchmarks except BoolQ and PaLM-540B on all but BoolQ and WinoGrande; LLaMA-13B beat GPT-3 on most despite being 10× smaller.
    • Touvron et al., 2023, LLaMA (arXiv preprint arXiv:2302.13971), §3.1

Source

  • Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. In arXiv preprint arXiv:2302.13971. https://arxiv.org/abs/2302.13971