Comment by jacquesm

But they don't. That's the whole reason they work in the first place.

Every neuron in the layer encodes fractionally something about the concepts embedded in the whole thing. It's more like a hologram than a series of connected facts.