DEV Community

Arnold Holm
Arnold Holm

Posted on

0.47% a year: why your challenge target needs a different test

Your positive backtest can still miss the job you need it to do. Our saved pre-Fed currency test returned 0.47% a year after costs. On a $10,000 reference, that annual rate represents about $47.15. That tells you something about the historical return. It does not tell you whether your account can reach its challenge target before a loss rule stops it.

The result that looked useful

The idea was simple. Hold a basket of currencies against the US dollar during the 24 hours before a scheduled Federal Reserve rate announcement. Close at the announcement. Keep the same rule across the whole test.

Our historical simulation used eleven currency pairs from 2017 through 2023. The total position value was half the reference account size, with a 1.99% stop on each position. Its maximum initial risk was 0.995%. Both sides of the transaction cost were included.

The result was positive in the development period and in both later validation periods. Doubling costs, adding another 0.01 percentage point of cost, and removing the stop still left both validation periods positive.

Those are useful checks. They help separate a result that survives small changes from one that depends on a lucky setting. But I still rejected this case for the funded strategy we were testing.

The saved 2017-2023 pre-Fed currency simulation, with its small positive account-value curve.

A small positive rate is still small

The combined annual rate was 0.47%. The largest drop from a previous peak was about 0.40% in this saved run. That can make the chart feel comfortable to read. It also makes it easy to forget the size of the profit required.

Take an example $10,000 challenge with a $1,000 profit target and a $500 daily loss allowance. Those are example rules to put beside the result, not rules attributed to a particular firm. The annual-rate figure of $47.15 is a geometric average expressed on that same reference amount. It is not a statement that each year earned exactly $47.15.

Before deciding this chart fits your challenge, you need a different view: the actual sequence of opportunities, trades, open losses and target checks. A smooth annual summary cannot answer how long the next opportunity takes to arrive.

The calendar matters

This rule trades around scheduled announcements. It does not produce a new setup every morning. A quiet stretch in the account curve can be a period with no eligible event, rather than a fault in the program.

That distinction changes what you ask of a trading bot. If your program is meant to act only before the next scheduled event, opening a position today would change the rule. Adding other trades to speed up progress would also change the test.

I would put the eligible event times next to the challenge's deadline, minimum trading days and reset time. Then I would replay the account from the intended start date. The question is whether that sequence fits the rules you actually bought, including any news restriction at the firm.

Bigger positions need another test

The obvious response is to increase the position size. But the small loss shown here belongs to the exposure and stop settings used in this run.

Increasing size changes the loss at the stop, the margin needed, and the room left beneath a daily loss limit. It may also change which orders can be filled. The old chart cannot stand in as evidence for the larger version.

In our research, the 0.47% result fell below the return threshold set before the test. There were also failures in a comparison with an unrelated calendar window and in the concentration of positive results across pairs. Positive validation results did not erase those failures. The final decision stayed rejected.

What you can check today

Write down your account size, profit target, daily loss rule, overall loss rule and deadline. Keep the firm's definition of account value and its reset time beside them. Then ask whether your report contains the full account path needed to check each rule.

For an event strategy, include the days when there is no trade. For a bot with open positions, include their unrealised loss. Test the proposed position size itself. Do not borrow the loss numbers from a smaller version.

If you want to start with your own rules, the free Challenge Pre-Check is the next step.

This case is a saved historical simulation, with no customer account, live orders or completed challenge behind its result.

Top comments (0)