transformers

Mechanistic Interpretability: What We Actually Know So Far

Mechanistic interpretability has produced real, reproducible findings. Here is an honest accounting of what those findings actually mean for engineers.