The prediction quality of forecasting agents relies heavily on both reasoning models and retrieved external evidence, making it difficult to evaluate each independently without future data leakage. Researchers launched ForecastGym, a live, controlled, and replayable evaluation environment. This framework combines prospective data collection with an offline replay mechanism, enabling researchers to precisely isolate the impact of evidence retrieval quality from a model's core reasoning capabilities.
Mecky Alvin Tanuwidjaya
Posted on • AI-assisted
Top comments (0)