RSS GitHub
The Ledger A sourced historical record of AI

Anthropic Publishes Circuit Tracing and 'Biology of a Large Language Model'

A ledger entry in the research archive, dated 2025-03-27.

Summary

Anthropic published its attribution-graph methods paper and companion study of Claude 3.5 Haiku on March 27, 2025. The open-source circuit-tracing library and Neuronpedia interface followed on May 29, a separate release that enabled researchers to generate and explore attribution graphs on supported open-weight models.

Editorial correction, October 26, 2026

The March 27 papers and May 29 tooling announcement are distinct publications. The tooling citation's original March 27 publication date is corrected to May 29. The original body's simultaneous-tool-release wording is preserved below as the earlier assertion.

Revision record with the prior summary and metadata.

The original narrative below is preserved as published; use the revised summary and this note for the corrected account.

What Happened

The attribution graph methodology provides a framework for tracing which internal circuits drive specific model behaviors, creating maps of computational pathways analogous in spirit to functional anatomy. The companion biology paper applied this approach to Claude 3.5 Haiku, examining behaviors including multilingual reasoning, multi-step planning, hallucination dynamics, and refusal activations.

A headline finding was the existence of a language-agnostic conceptual space: when Claude processes equivalent concepts in different languages, representations converge in a shared internal geometry before diverging again at the output stage. The refusal analysis traced the circuitry behind Claude's resistance to harmful requests, while the hallucination analysis identified failure modes in how models fill gaps in factual recall.

The tools were released open-source and integrated with Neuronpedia, a community platform for mechanistic interpretability research, allowing external researchers to explore the same attribution infrastructure.

Why It Matters

The release set a new benchmark for interpretability transparency at a major frontier lab. Prior mechanistic interpretability work had focused primarily on toy models or early, smaller transformers; applying the methodology at the scale of a deployed commercial model and releasing the tools externally represented a significant step. The biology framing also shifted language in the field — treating the model as a subject of empirical study rather than an engineered artifact whose behavior can be fully specified in advance — with implications for how researchers think about the gap between training objectives and learned behavior.

§ How to read the metadata
Landmark
Fundamentally alters the trajectory; 2–5 per year.
Major
Meaningfully shifts the landscape; 2–4 per month.
Notable
Worth documenting; significance can be upgraded later.
Confidence
High = primary sources corroborate. Medium = credible secondary only. Low = provisional. Disputed = credible sources disagree.
Contestation
Uncontested = no formal challenge. Contested = at least one challenge open. Superseded = replaced by a later entry. Unresolved = dispute still open.

References

  1. Attribution Graphs: Methods , Transformer Circuits Thread (2025-03-27) primary document
  2. On the Biology of a Large Language Model , Transformer Circuits Thread (2025-03-27) primary document
  3. Tracing the Thoughts of a Large Language Model , Anthropic (2025-03-27) official
  4. Open-sourcing circuit tracing tools , Anthropic (2025-05-29) primary document archived copy

See also