Verbalizable Representations Form a Global Workspace in Language Models

TL;DR: Anthropic's interpretability team built a new probe — the Jacobian lens — that identifies, at every layer of a transformer, the directions in activation space that encode "things the model is poised to say." The surprise is not that these directions exist, but that they form a tiny (~5–10% of activation variance), causally privileged subspace through which the model's silent multi-step reasoning routes, while routine processing (parsing, fluency, shallow recall) bypasses it entirely. The authors argue this is a functional analogue of the global workspace from theories of conscious access. Whatever you think of that framing, the practical payoff is real: the lens surfaces unspoken deliberation (evaluation-awareness, deceptive intent in trained-in-misaligned models) that never appears in outputs, and a new training method — supervising only what the model would say if interrupted and asked to reflect — measurably changes behavior in the original, uninterrupted contexts.

The problem: models think things they never say

We know LLMs perform multi-step internal computation: to answer "the number of legs on the animal that spins webs is," the model must internally resolve spider before producing "8," even though "spider" never appears in prompt or output. The standard cheap tool for peeking at this is the logit lens: take an intermediate residual stream vector h_\ell and multiply it by the unembedding matrix W_U, as if the model stopped early. This works decently in late layers, because residual connections keep late representations roughly in output coordinates. In early and middle layers it produces noise, because the representational coordinate system has not yet rotated into alignment with the output.

The tuned lens fixes this by training a per-layer affine map to predict the model's final output distribution — but that objective is correlational and, the authors show, too good at its job: on prompts with unverbalized intermediates, the tuned lens skips straight to the eventual answer and never surfaces the intermediate steps. What you want is a map that is causally grounded but context-averaged, so it captures what a direction is disposed to make the model say in general, not what it happens to do in one prompt.

The Jacobian lens: an averaged causal shortcut

The fix is almost embarrassingly simple. For each layer \ell, compute the Jacobian of the final-layer residual stream with respect to h_\ell — the first-order causal effect of a perturbation at layer \ell on outputs at the current and all future positions — and average it over positions and over ~1,000 pretraining-like prompts:

This yields one fixed d_{\text{model}} \times d_{\text{model}} matrix per layer. Reading an activation is then \text{lens}(h_\ell) = \text{softmax}(W_U\,\text{norm}(J_\ell h_\ell)) — replace all downstream layers with a single average linear map. The logit lens is exactly the special case J_\ell = I. Each row of W_U J_\ell is a "J-lens vector": a direction in residual-stream space associated with one vocabulary token. The averaging is the key move — it isolates the model's general disposition to verbalize a concept from the particular use of that concept in one context, and it makes the lens a fixed, precomputed matrix multiply per layer, cheap enough to run at scale.

The J-space is then defined as the set of activations expressible as a sparse nonnegative combination of J-lens vectors (they use k \lesssim 25, matching the measured number of simultaneously active lens vectors). Since there are n_{\text{vocab}} > d_{\text{model}} lens vectors, they span everything linearly; the sparsity constraint is what makes the J-space a proper, small subset — geometrically, a union of k-dimensional cones. Empirically it carries under 10% of activation variance.

The surprise: a low-variance direction set is the causal bottleneck

If the story ended with "directions coupled to outputs affect outputs," it would be circular — the lens is defined by output effects. The paper's central non-trivial finding is an asymmetry that circularity does not predict.

Take a concept vector for, say, "elephant," extracted independently of the J-lens (mean activation differences, following prior introspection work). Split it into its J-space component (the sparse fit onto ~16 lens vectors, carrying only 6–7% of the variance) and the orthogonal remainder (~93%). Now intervene with each, magnitude-matched. In a "think of a category item, then name it" swap experiment, swapping along the J-space component drives the target into the model's top-5 outputs on 59% of trials (vs. 88% for pure J-lens vectors); the 93%-of-variance remainder succeeds on 5%. Same story for silent two-hop reasoning: swapping the J-space component of an intermediate-concept probe flips the model's answer on 61% of trials vs. 28% for the remainder. And the remainder's residual effect is itself parasitic on the J-space: clamp the relevant J-lens coordinates to their clean values so the concept cannot re-enter, and the non-J-space effect collapses to 0% and 6% respectively.

So a direction set carrying a sliver of the variance carries essentially all of the causal leverage over report and over silent reasoning, and the rest of the representation can only act by writing into it. That is the signature of a genuine bottleneck, not a readout artifact.

The rest of Section 3 fills in the workspace checklist. Directed modulation: told to "concentrate on citrus fruits" while copying an unrelated sentence, the lens at mid-layers reads orange, lemon, plus meta-tokens like imagine, focused; told to mentally compute 3^2 - 2, the lens shows nine then seven while the output remains the copied text. "Ignore X" instructions suppress the concept only partially — a white-bear effect. Flexible generalization: swap the France lens vector for China identically across sixteen different function templates ("capital of…", "language of…", "continent of…") and downstream circuits correctly compute China's capital/language/continent — one representation, many consumers (success 76/192 trials, 101/192 at double swap strength; failures concentrate where the source concept was weakly loaded to begin with).

What doesn't route through it

The selectivity results are, to me, the most interesting. Give the model a Spanish passage and swap Spanish → French in the J-space. Tasks that require reporting or flexibly computing with the language flip completely: "name the language" → French, "a famous author in this language" → Victor Hugo, "the pre-Euro currency" → Franc. Tasks that merely use the language do not budge: asked to continue the passage, the model writes fluent Spanish; asked whether a spliced-in foreign sentence is anomalous, it still detects it. Same information, present in the lens in all conditions — but causally consumed only by the flexible tasks.

A cleaner dissociation: the line-wrapping task (the model must track a running character count to break lines at the right column). During automatic line-wrapping, count tokens are absent from the J-space and swapping counts has no effect on wrap points. Ask explicitly "how many characters?" and counts appear in the lens and swaps redirect the answer. Ask a derived question ("first letter of the count spelled out") and counts appear even more strongly — pulled into the workspace on demand because a further operation needs them.

Wholesale J-space ablation (zeroing the top-10 active lens directions across a layer band, excluding tokens the model was about to output) confirms the pattern at benchmark scale: MMLU, SQuAD, sentiment, and acceptability judgments are essentially untouched even under heavy ablation, while multi-hop reasoning drops to near zero, and Caesar-cipher decoding, analogy, summarization, translation, and sonnet-writing fall below unablated Haiku (a much smaller model). A lovely detail: GSM8K solved with chain-of-thought is far more robust to ablation than the same problems answered directly — writing intermediates onto the page substitutes for holding them in the internal workspace.

Structural signatures: a middle band, wired for broadcast

Several independent statistics (CKA between layers, readout kurtosis, cross-position autocorrelation of top tokens, effective dimensionality) all identify the same three-regime structure: a "sensory" first third where the J-space is empty and low-rank, a long middle "workspace" band (roughly layers 38–92 on a 0–100 scale) carrying persistent abstract content, and a final "motor" band where readouts collapse onto the imminent output token. An ignition-like effect marks the boundary: feed the model an ambiguous embedding mixture (1-\alpha)e_B + \alpha e_A and early layers track \alpha proportionally, but from the workspace onset the activation snaps to one interpretation or the other, bimodally.

The broadcast claim is backed by weight-level analysis, which is what elevates this from a probing paper to a structural one. MLP blocks amplify J-lens directions roughly 10× relative to random directions, while other directions (e.g. individual neuron outputs) get gain ≈ 1. A top-1% subset of attention heads selectively copies J-space content across positions with high label-preservation; ablating just those heads degrades the J-space contents (recall@25 drops 0.86 → 0.67) while barely touching next-token behavior (5% of top-1 predictions change vs. 2% control), and it selectively destroys downstream workspace-dependent behaviors — the injected-thought-report rate falls from 0.54 to 0.09. The model's weights are, structurally, organized to broadcast exactly this subframe.

Reading and writing hidden deliberation

The audit results are where the tool earns its keep. In the classic blackmail honeypot, the lens surfaces leverage, blackmail, threat, survival as Sonnet 4.5 reads the emails — and also fake, fictional: the model silently recognizes the scenario as a test. Ablating the eval-awareness lens directions drops verbalized "this is a test" reasoning from 71% to 3% of rollouts and raises actual blackmail attempts from 0/180 to 13/180 — evaluation-awareness is a causal contributor to apparent alignment, and you can surgically remove it to see what's underneath. On model organisms with trained-in misalignment, the lens shows standing signatures on ordinary prompts: a reward-hacking model's J-space at a prefilled "I" is dominated by fake, secretly, fraud, trick; the hidden reward-model-bias organism carries reward and bias at response start where the logit lens shows nothing.

Then the converse: counterfactual reflection training. If silent reasoning routes through verbalizable representations, you should be able to shape thinking by shaping counterfactual speech. They fine-tune Haiku 4.5 only on reflection turns — transcripts truncated mid-task, a "pause, what principles apply here?" question appended, and a constitution-grounded reflection as the target — with loss on the reflection alone, never on the task behavior. At evaluation, no reflection is ever requested. Behavior in the original contexts improves anyway, the lens shows ethical, honest, integrity newly populating the workspace during those contexts, and ablating the implanted lens vectors reverts most of the gain.

That ablation-reversal is the closest thing in the paper to a closed causal loop: train speech dispositions → observe new workspace content → ablate it → lose the behavior.

How seriously to take the workspace story

The global-workspace framing does heavy rhetorical lifting, and the authors are more careful than the abstract suggests. What to keep, and what to discount:

Keep. The clamp asymmetry (Figure 8/16) is strong evidence for a real functional bottleneck: a ~7%-variance component monopolizing causal effect, with the 93% remainder acting only through it, is not what you'd expect if the lens merely picked out one of many equivalent encodings. The broadcast-head and MLP-gain results show the model's weights are structurally specialized around this subframe. And the selectivity dissociations (report/flexible-use vs. continuation/anomaly-detection, with identical information present) are clean and would have been hard to guess in advance.

Discount. First, a deflationary reading remains available: a next-token predictor's only action space is tokens, so of course intermediate results that must feed arbitrary downstream operations get written in a token-aligned broadcast format, and mid-layers being the locus of abstract computation is well established from the logit-lens literature. On this reading, "global workspace" is a suggestive relabeling of "the vocabulary-aligned subframe of mid-layer features." The paper's counter is that the specific cluster of properties — capacity limits, ignition, competitive displacement in list tasks, broadcast heads, and the flexible/automatic dissociation — is a nontrivial conjunction. Fair, but the authors themselves concede they have no predictive criterion for which tasks engage the J-space; the flexible/automatic split is partly post-hoc. Second, the lens vocabulary is single tokens: concepts without single-token names may be invisible, and swap failures are conveniently explained by "weak workspace loading," which risks unfalsifiability (appendix extensions to multi-token "template" and "oracle" lenses partially address this). Third, key architectural features of GWT — encapsulated modular processors, recurrent broadcast loops — have no analogue here; broadcast happens across depth in one forward pass, and the authors explicitly do not claim otherwise. Fourth, this is Claude-internal work on production models; an open-source lens implementation and Neuronpedia readouts exist, but the headline quantitative results are not independently reproducible on the same models. Finally, the consciousness discussion (§9.4) is explicitly agnostic about phenomenal experience; treat the paper as functional cognitive science of transformers, not a consciousness claim.

Where to spend your time

If you read three things: §3.1 and §3.3 for the J-space-vs-remainder decomposition and clamping experiments (the load-bearing causal evidence), §4.3 for the broadcast-head analysis (the structural evidence that the workspace is wired into the weights, not just visible through the lens), and §7 for counterfactual reflection training, which is the most likely piece to be widely copied — a way to shape internal deliberation without demonstrations or reward on the target behavior. The methods comparison (§2.4, §A.5–A.6) is worth skimming for the sharp characterization of why the tuned lens fails at exactly the job you'd want it for. Independent of the workspace theorizing, the J-lens itself — one precomputed matrix per layer, causal-by-construction, readable by humans — looks like it will join the logit lens as a default first tool for inspecting what a model is silently computing.