Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

huge. the activation scan, which looks for which nodes change the most when prompted with the words "Golden Gate Bridge" and later an image of the same bridge, is eerily reminiscent of a brain scan under similar prompts...