Imagine judging how safe a sport is by interviewing only the people at the finish line. Everyone you talk to is fine, so you conclude the sport is harmless — never noticing that the people who got hurt are not in the room to be counted. That is survivorship bias: drawing conclusions from a sample that has already been filtered down to the winners.
The Planes That Came Back
In WWII, analysts studied bullet holes on returning bombers and wanted to add armor where the holes clustered. The statistician Abraham Wald pointed out the flaw: they were only looking at the planes that came back. The areas with the fewest holes on survivors — the engines — were exactly where a hit was fatal. The armor belonged where the survivors had no holes.
How It Poisons Financial Data
Funds that perform badly get closed and drop out of databases. Delisted companies fall out of indices. Blown-up strategies never get written about. What's left is a highlight reel, and any "average return" computed from it is flattering by construction.
Why Backtests Inherit It
Test a strategy on "the companies currently in the index" and you've quietly excluded every company that went to zero. The backtest looks robust because it was never shown the wreckage. Combined with overfitting, the equity curve is confident precisely because the hard cases are absent.
How We Guard Against It
The only real defense is keeping the failures in the data. In our public forecasting experiment every call is locked and Bitcoin-timestamped before the event, so we can't delete the ones that turn out wrong — the losers stay permanently on the record next to the winners. Right now the market is ahead of our model, and that number stays visible on purpose. A track record only means something when nothing has been edited out of it: neuportal.ai/experiment
Educational content — not financial advice, and not a betting tip.
Top comments (0)