Originally published on AI Tech Connect.
What the study found Three context strategies were compared. No context file at all; the repository's real AGENTS.md injected into the system prompt every turn; and a topic-organised wiki left in the workspace for the agent to retrieve on demand. Two frontier agents were tested. Claude Code and Codex, run against the same task set on the same repositories. The correctness difference was not measurable. The paper states that context strategy "does not measurably move correctness on either agent", with the effect bounded to no more than 10 to 15 percentage points by equivalence testing. Adding the real AGENTS.md converted no near-miss failure into a pass. On either agent. The tasks that failed, failed for reasons a context file did not address. One effect did reach significance. On Claude,…
Top comments (0)