Toolformer: Language Models Can Teach Themselves to Use Tools

Schick et al., 2023, Toolformer (Advances in Neural Information Processing Systems 36 (NeurIPS 2023))

Subscriber deck — free during early access

1 cards in “3 Tools” · whole deck

3 Tools

  1. Which tools did Toolformer learn to use?
    A question answering system (Atlas), a calculator for the four basic operations, a BM25 Wikipedia search engine returning snippets, a machine translation system into English (NLLB 600M) and a calendar returning the current date. The only requirements: text input and output, and a few demonstrations.
    • Schick et al., 2023, Toolformer (Advances in Neural Information Processing Systems 36 (NeurIPS 2023)), §3

Source