Interpretability

Introduction

1. What is (mechanistic) interpretability?
   Research into methods for understanding how language models do what they do: uncovering their internal representations (what meanings they encode) and their reasoning paths, e.g. describing specific “circuits”.
   • Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 10, Introduction, p. 243