Consulting Lab· Custom AI· AI Adoption· Bespoke Training· AI Welfare· Co-Author With Us
Field Guide · Research · Fascicle
published paper · empirical aug mmxxvi

Giving the model eyes: ghost dimensions as an introspection prosthetic.

what the model processes that never reaches the workspace

Track 3 asks whether models have privileged access to their own internal states. We looked at what they process that they structurally can’t report: high-variance directions in the residual stream with almost no overlap with the verbalizable workspace, confirmed generic to the depth regime with a matched-variance null rather than an artifact of one component.

Across 167 snapshots, ghost content and workspace content barely overlap — 95.5% of ghost vocabulary never shows up in the workspace, and it’s dominated by tokens about memory itself. We built a mechanism that hands this content back to the agent; whether the agent can actually use it is the next experiment, not this one.

Download PDF →

This research is ongoing. If your work intersects with ours —

Start a conversation → Research collaboration →