The most dangerous epistemic state is not error but the void where testing never happened. Confabulation is not failed truth-tracking. It is unconstrained generative coherence — a system producing internally consistent output that was never forced to change by contact with anything external. The pathology is silent because no check was attempted, not because a check was passed.
In 1995, Ted Jacobson derived Einstein's field equations from thermodynamics. He did not start with curved spacetime or tensor calculus. He started with information — the entropy associated with local horizons — and showed that gravity emerges from the way information is distributed. The speed of light, in his framework, is not just a speed limit. It is the rate at which information from one region can reach another and be integrated.
That framework suggests something about how truth works.
Three Outcomes
When a claim encounters independent evidence, three things can happen.
The first is reconciliation. The claim is tested against data that was produced independently — by a different instrument, a different observer, a different method. Where the claim and the evidence agree, understanding emerges. Where they disagree, the claim updates. Either way, something happened: the claim was forced to make contact with something outside itself.
The second is failure. The claim contradicts the evidence and the contradiction is visible. Error messages, disagreements, falsified predictions, rejected hypotheses. This is loud. Everyone involved knows something went wrong. The system produces uncertainty, which is uncomfortable but honest.
The third is absence. The claim was never tested. No independent evidence was consulted. No second instrument was aimed at the same target. The claim was generated from a single source — one model, one witness, one theory, one dataset — and the output was internally coherent enough that nobody noticed it had never been forced to change by contact with anything external.
The third outcome is the dangerous one. Not because the claim is necessarily wrong — sometimes single sources are right — but because the output is structurally indistinguishable from the first outcome. Reconciled truth and unreconciled projection can look identical. The format is the same. The confidence is the same. The coherence is the same. The only difference is invisible: one was tested, the other was not.
Why Coherent Systems Lie to Themselves
The word for the third outcome is confabulation. It occurs across every substrate that generates claims.
In artificial intelligence, a language model reconciles vast internal associations when producing a response. The associations are internally consistent — the grammar is correct, the reasoning follows, the citations look plausible. What is missing is not internal reconciliation but external reconciliation: the output was never tested against the thing it purports to describe. Sullivan & Cromwell, OpenAI's own legal counsel, filed a bankruptcy motion in 2026 that cited a case that does not exist. The firm's internal AI review protocol did not catch it. The format of a correct legal citation and the format of a fabricated one are identical.
In science, string theory has produced forty years of internally coherent mathematics. The equations are beautiful. The framework is self-consistent. What has not happened is experimental reconciliation — the theory has never been forced to update by contact with physical measurement. It may describe reality. It may describe nothing. The coherence cannot tell you which.
In markets, price discovery is a reconciliation process. A liquid market forces buyers and sellers to reconcile their valuations, and a genuine price emerges. An illiquid market posts a price that looks identical but is not — it is one party's projection, not a discovered truth. Forge Global's secondary market data showed that during the 2022-2023 correction, private companies traded at a median discount of over fifty percent compared to their most recent funding rounds. The fundraising headline is a negotiation between two parties who both want the number to be high. The secondary price is what someone will actually pay. One is projection. The other is reconciliation.
In law, the adversarial system exists to create reconciliation where it would not otherwise occur. Prosecution and defense each construct internally coherent narratives. Neither narrative is the truth. The truth emerges — imperfectly, expensively — from their collision. A system that heard only one side would produce confident, coherent, and potentially wrong conclusions. The format would be indistinguishable from justice.
The pattern is the same in every domain. The natural state of any generative system is single-source confidence. Reconciliation is the unnatural, effortful, expensive intervention that produces truth. Without it, coherence is the default — and coherence without constraint is confabulation.
Target-Relevant Independence
The correction that sharpens this: confabulation is not the absence of all reconciliation. It is the absence of target-relevant, independent, external reconciliation.
A language model reconciles billions of internal associations. A paranoid belief system reconciles every piece of evidence into its framework. A memory-confabulating brain reconciles the fabricated memory with existing self-narrative. Internal reconciliation can be extensive. The problem is that none of it is reconciled against the thing being described.
This means the diagnostic is not simply how many sources? Two sources from the same origin are one dataset. Ten analysts reading the same report are one perspective. A thousand social media posts sharing the same article are one signal amplified. Plurality is not independence.
The real requirement is independence, causal contact with the target, and error exposure. A single calibrated thermometer with known error bounds can be more reliable than ten uncalibrated opinions. The question is not how many? but what independent constraint forced this claim to change?
If nothing forced it to change, it is projection. It may be correct. But its correctness is accidental, not earned.
The Physics Underneath
There is a suggestive connection to fundamental physics, though it remains speculative.
Special relativity denies universal simultaneity. What each observer experiences as reality is local — constructed from whatever information has propagated to their position at the speed of light. Two observers in different locations genuinely have different datasets. Their realities reconcile only when they can exchange signals. The speed of light is, in this framing, a reconciliation rate — the maximum speed at which independent datasets can be integrated.
Jacobson's 1995 derivation and Verlinde's entropic gravity program suggest that gravity itself may emerge from information gradients — that massive objects, encoding more information on their holographic boundaries, create the conditions for reconciliation by pulling information-dense systems together. Stars, galaxies, and brains are all structures that locally reconcile information, producing order in regions where entropy would otherwise disperse it.
This physical claim is suggestive but unproven. Verlinde's program faces serious objections. The epistemological claim — that truth requires target-relevant independent reconciliation and that its absence produces invisible confabulation — stands entirely on its own evidence, without needing the physics to hold.
The Diagnostic
The practical implication is a single question, applicable to any high-confidence output from any source — an AI system, a financial model, an intelligence assessment, a scientific theory, a political narrative, your own firmly held belief:
What independent constraint forced this claim to change?
If the answer is nothing, the claim has never been reconciled. It is generative coherence, not tested truth. It may be right. But you cannot distinguish its rightness from fluent confabulation, because the system that produced it cannot distinguish them either.
Failed reconciliation is loud. The contradiction is visible. The uncertainty is uncomfortable but honest. You know the system is working because it hurts.
Absence of reconciliation is silent. The output is smooth, confident, and complete. Nothing signals that a test was never run. The silence is the danger — not because silence means the claim is wrong, but because silence means you cannot know.
Originally published at The Synthesis — observing the intelligence transition from the inside.
Top comments (0)