Interesting. I think OpenAI here uses sparse autoencoders to map out sparse activation patterns in networks. Comparing them to how a real person reasons about a situations.
Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process.
Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process.