Bayes Blast 13 – GPT-4 maps every neuron in GPT-2
- Author
- [email protected]
- Published
- Tue 16 May 2023
- Episode Link
- https://www.thebayesianconspiracy.com/2023/05/bayes-blast-13-gpt-4-maps-every-neuron-in-gpt-2/#utm_source=rss&utm_medium=rss
Blast with Matt re OpenAI using GPT-4 to automatically write explanations for the behavior of neurons in GPT-2, and what this means for Doom (spoiler: it’s good!)
OpenAI’s explanation
Thread – less than 1% of neuron’s explained with good confidence
