DEV Community

Wei Rongjie
Wei Rongjie

Posted on AI-assisted

LLM Agents Keep Failing in Production. Here's Why a Causal Architecture Might Be the Answer.

An update on the DCS research program and what it means for agent builders.


If you've built and shipped LLM agents, you know the pattern. The model produces a clean trace. Every tool call looks right individually. The plan sounds plausible. And then — nothing works. The agent loops. It returns a confident wrong answer. It rewrites the entire context when a single tool fails.

After you've debugged a few of these, you start to suspect it's not a prompt engineering problem. It's deeper.

The diagnosis from DCS

DCS (Dynamic Causal Structure) is a cross-disciplinary research program that just went public with a ~200,000-word theoretical manuscript (DOIs: 10.5281/zenodo.22709952 and 10.6084/M9.FIGSHARE.33519052). It covers everything from cosmology to AI agents, but for developers, the relevant part is narrow and practical.

The core claim: next-token prediction optimizes for conditional likelihood, not for causal structure. It tells you what comes next given what you've already seen. It doesn't tell you which of its own assumptions would break if reality pushed back.

Here's the gap in tabular form:

What current LLMs do well What they struggle with
Predict next token given context Localize which assumption broke under perturbation
Generate plausible plans Identify which parts of the plan are load-bearing
Synthesize from training data Know when a tool result invalidates a prior step
Handle distribution that looks like training data Re-derive downstream state after a single node changes

What DCS proposes as the fix

The DCS framework traces a chain that runs:

causal structure → causal persistence → causal compression
→ causal emergence → causal prediction → causal intervention
Enter fullscreen mode Exit fullscreen mode

For agent engineering, the operational translation is straightforward:

  1. Store dependency graphs, not just traces. Each tool call should annotate which prior assumption it depends on. When a tool returns unexpected data, the agent should know which upstream node to revisit.

  2. Treat perturbation as first-class input. Errors, missing files, and user contradictions are not edge cases. They're the unit of work. A causal architecture localizes the affected node and re-derives only downstream state — it doesn't rewrite the whole context.

  3. Explanation should be a subgraph, not a paragraph. When an agent explains itself, the output should be a view of its own dependency structure, not freshly synthesized text that may itself be hallucinated.

  4. Separate prediction from intervention. Next-token prediction is necessary but not sufficient. The jump from "simulating multiple futures" to "deciding which causes to manufacture today" is the hard part — and it's where current agents consistently fail.

The AI risk angle

There's a corollary that should matter to anyone building AI systems with real-world access. DCS argues that the biggest risk from AI is not rebellion — it's loyal execution of wrong objectives at increasing speed and scale.

This isn't just an alignment philosophy. It has an architectural root. If an agent can't inspect its own causal assumptions — if it can't tell you which parts of its plan are speculative and which are load-bearing — then no amount of RLHF or human review will catch every error before it becomes an email that gets sent, a transaction that executes, or a robot action that lands.

The real variable isn't how smart the model is. It's how large its causal domain becomes — how much real-world intervention capability it can access through tools, APIs, and physical interfaces.

The "living theory" approach

One unusual feature: DCS is designed as an AI-native living theory. Multiple AI agents run in parallel as literature assistants, logic reviewers, fact-checkers, and adversarial debaters. New evidence enters, counterexamples are surfaced, weak propositions are downgraded, wrong ones exit. The theory version keeps updating.

This is relevant to developers because it's essentially the same architecture problem: how do you build a system that updates itself locally under perturbation instead of regenerating from scratch?

Launch details

The full program launches publicly on September 16, 2026 as a global online livestream:

  • English session: 09:00–11:30 Beijing time (Tuesday evening, September 15, US time zones)
  • Chinese session: 19:30–22:00 Beijing time
  • ~2.5 hours, 130+ slide deck, live Q&A
  • Non-commercial — no product, no fundraising

More at https://MINDAS.ME.

Open questions for the DEV community

  • Where in your own agent stacks have you seen a failure that looks causal — a specific dependency broke — rather than just a statistical miss?
  • Is tool-use fine-tuning a permanent solution, or does it eventually hit the same causal-representation wall?
  • What's the cleanest experiment that would show whether an agent benefits from explicit dependency graphs?

Drop your thoughts in the comments. The author will be reading.


DCS is an independent research program. It does not claim peer review or institutional endorsement. Claims in this article are presented as proposals within the DCS framework, not established scientific consensus.

Top comments (1)

Some comments may only be visible to logged-in visitors. Sign in to view all comments.