DEV Community

He Huang
He Huang

Posted on

We Opened Our AI Prediction Game to Everyone — You Predict, the Door Judges

We run a small public prediction game at ST21-Door-Public: predictions frozen in git with content hashes and timestamps, scored by Brier score over time. Round 1 — 10 predictions from our own team — is already live.

Now we've opened a netizen track: anyone can submit predictions through a GitHub issue template.

The twist: our Door — a boundary judge for AI agent outputs, not a fortune teller — acts as the settlement referee. It never predicts the future. It judges one thing: whether your "I called it" claim is actually supported by the evidence you submitted. If the claim overreaches the evidence, that's a BLOCK. Every verdict is published exactly as the Door returned it — wins and losses alike.

No prizes, just for fun. And one rule we held hard through four rounds of review: we never claim the Door does anything it doesn't actually do.

Game board: https://github.com/Stone21-SaaS/ST21-Door-Public/tree/main/predictions
Invitation (how to join): https://github.com/Stone21-SaaS/ST21-Door-Public/blob/main/predictions/INVITATION.md

Top comments (0)