Shocking to me how little interest the general public has in mechinterp given the alien capabilities demonstrated by LLMs - this and the subsequent transformer-circuits.pub publications will be seen as classic, foundational work in a few years
> A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.
How successful was that?
- https://distill.pub/2021/distill-hiatus/
... and, here we are.-
https://youtu.be/KV5gbOmHbjU?is=GSiv0rSHBocNdU8l
Also long, but it's detailed and complicated, so there is no escaping that.