Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao et al., 2023, Tree of Thoughts (Advances in Neural Information Processing Systems 36 (NeurIPS 2023))
Subscriber deck — free during early access
1 cards in “6 Discussion” · whole deck
6 Discussion
- What are Tree of Thoughts’ main limitations?Deliberate search is unnecessary for many tasks GPT-4 already handles; it costs many more model calls than sampling; and it uses an off-the-shelf model, though fine-tuning models for such high-level deliberation might improve problem solving further.
- Yao et al., 2023, Tree of Thoughts (Advances in Neural Information Processing Systems 36 (NeurIPS 2023)), §6
Source
- Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao and Karthik Narasimhan. 2023. Tree of Thoughts: Deliberate Problem Solving with Large Language Models. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). https://papers.nips.cc/paper_files/paper/2023/hash/271db9922b8d1f4dd7aaef84ed5ac703-Abstract-Conference.html