DEV Community

Dron Pancholi
Dron Pancholi

Posted on

I asked 18 AI trading bots for one file. 17 couldn't show it.

I asked 18 AI trading bots for the same thing.

Not their returns. Not their screenshots. Not their testimonials.

One file. The prediction file. Date, prediction, actual. The raw record of what they called and what happened.

17 couldn't show it.

No data. No method. No record. Just a chart and a win rate.

One could.

17 ads. 1 claim.

Here's the thing nobody tells you about a 70% win rate: it means nothing until you count the trades.

70% over 20 trades has a Wilson 95% interval of 48–85%. The true edge could be below a coin flip.

70% over 100 trades is 60–78%. Same headline. Different truth.

I once watched a grid bot print 300% APR. Recomputed it from the file: 3% in two weeks, annualised. The screenshot was real. The edge wasn't.

So I built a tool that does the check in your browser, free, nothing uploaded. Paste the prediction file. It recomputes the accuracy, runs it against always-bullish and no-change baselines, splits it into five chronological folds, and gives you one of four verdicts: edge demonstrated, overfit, weak, or no edge.

Try it: https://startbuildit.online/lie-detector/

If a bot won't show you the file, it's selling you the screenshot.

The full story, with the numbers: https://startbuildit.online/

Top comments (0)