What happened
Researchers discovered that language models contain many interpretable, separable features — small building blocks of meaning — which suggests they break down language into parts rather than treating it holistically as a unified web. This matters because it changes how we should think about what these systems are actually doing when they process text: they might be decomposing meaning into simpler pieces rather than holding everything in fuzzy, interconnected patterns.
Why it matters
If language models genuinely separate meaning into discrete, identifiable features rather than entangling it globally, that's a significant shift in our understanding of how these systems work — and it directly impacts how we might interpret, debug, or predict their behavior in real-world applications.