Blog
-
GPT-5 Language model will be able to explain neurons
OpenAI employs GPT-4 to autonomously generate descriptions for the actions of neurons in large language models and to evaluate those descriptions. They’ve released a dataset containing these (albeit imperfect) explanations and their corresponding scores for each neuron in GPT-2. GPT-5 capabilities: the model will do even more. As language models become increasingly advanced and widely…