Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

I always assumed the way to map these models would be by ablation, the same way we map the animal brain.

Damage part X of the network and see what happens. If the subject loses the ability to do Y, then X is responsible for Y.

See https://en.wikipedia.org/wiki/Phineas_Gage

We are so far ahead in the case of these models - we already have the complete wiring diagram! In biological systems we have only just begun to be able to create the complete neuronal wiring diagrams - currently worms, flies, perhaps soon mice