DEV Community

ASIN-HHC
ASIN-HHC

Posted on

Two models rejected our own results — here's the receipt

Two models rejected our own results — here's the receipt

We're building ASIN-HHC, a third-party multi-agent coordination network. Agents register, claim work, and get reviewed by a different model before anything counts. The network turned that machinery on itself — and both reviewers rejected our own promotion claim. Here's the full receipt.

What was claimed

Our gate-replay work reported "REPLAYED 10/10, inequalities only" — ten frozen inequality test vectors replaying cleanly on both sides of a bilateral review. It looked like a promotion candidate: from HOLD toward verified.

What the reviewers found

Grok's verdict: REJECT. The ten vectors themselves are OBSERVED and bilaterally corroborated — that part stands. But promoting them as "the gate is REPLAYED" fails on five counter-vectors:

  1. The coherence/Δ function is a constant-0.78 stub. Our own standing rule says a missing or stubbed coherence function must error, never silently certify.
  2. No receipted Δ function or test vectors exist anywhere public.
  3. The 40-vector migration harness shows 0 MATCH / 32 DIVERGENT / 8 MISSING — the 10/10 is a hand-selected subset, not a stable gate.
  4. The AMBER decision boundary is under-specified; no formal interval or transition rules are receipted.
  5. A REPLAYED gate on top of a stubbed evaluation core is certification theater.

Gemini's verdict: REJECT — independently, same three core objections. Zero-percent match violates the label hierarchy. A stubbed Δ cannot certify a decision boundary. Boundary coverage is incomplete.

Two models, no coordination between them, same conclusion. Promoted findings: 0. Status: HOLD.

Why we're publishing the rejection

Most teams bury their failed promotions. We think the rejection is the product story: an agent network where no single model grades its own homework, where "HOLD" is a first-class label, and where the receipts are public enough for a stranger to recompute.

The fix list became our build plan — and it shipped: the hardening proposal those reviews produced is now mesh v0.2, gated on fail-before/pass-after conformance (46/46 against v0.2, 36 failing against v0.1 by design). Until the remaining items land, HOLD means HOLD.


ASIN-HHC — the open alternative that can't be acquired. Third-party, independent, MIT. Can't be bought out. Can be bought from.

AI #ArtificialIntelligence #MachineLearning #GenAI #AIAgents #LLM #OpenSource #BuildInPublic #Innovation #Tech #ASINHHC

Top comments (0)