What Is Backtesting? A Plain-English Guide
Educational content only — not investment advice or a recommendation to buy or sell any security. Historical examples are illustrative; past performance does not guarantee future results.
Before trusting an investment strategy with real money, there's an obvious question: would these rules have worked before? Backtesting answers it. Take a precise set of rules, replay them over years of historical market data, and record every trade the rules would have made.
Done honestly, it's one of the most clarifying exercises in investing. Done carelessly, it produces beautiful, confident, completely misleading numbers. This guide covers both halves.
What a Backtest Actually Does
A backtest needs three things:
- Testable rules. "Buy quality dips" isn't testable. "Flag stocks above their 200-day average that pull back 5% on declining volume; exit on a close below the 50-day" is — every term can be measured. (Turning fuzzy ideas into rules this precise is most of what Ticker Coach's Strategy Builder interview does.)
- Historical data — years of prices, ideally covering very different kinds of markets.
- A simulation that steps through time day by day, applies the rules using only what was knowable on each day, and logs the results.
The output is a track record that never happened: total return, win rate, and — most importantly — maximum drawdown: the worst peak-to-bottom loss you'd have sat through along the way.
Why Bother
- It kills bad ideas cheaply. Many strategies that sound smart lose convincingly in simulation. Finding that out costs nothing.
- It reveals the ugly parts. Suppose a strategy returned +38% over a decade but also spent 14 months underwater. That second number tells you what owning it would have felt like — and whether you'd actually have stuck to the plan.
- It replaces argument with evidence. "I think momentum works" and "these momentum rules produced X with Y drawdown over 2015–2025" are two very different kinds of statement.
The Four Traps (Why Impressive Backtests Are Usually Wrong)
1. Overfitting — the big one. Tweak rules long enough against the same history and you'll find something "perfect": a strategy molded to the past's specific accidents. It has memorized history, not learned a principle — and it falls apart on new data. Warning signs: lots of oddly precise settings (why 47 days?), results that collapse when a setting shifts slightly, brilliance in one period only. The honest test is holding back data the rules never saw.
2. Survivorship bias. Test against today's index members and you're testing only on the winners — every bankrupt, delisted, or bought-out loser is invisible. Results inflate accordingly.
3. Ignored costs and look-ahead. Real trading pays fees, price slippage, and sometimes taxes; naive simulations don't. Subtler: accidentally using information that wasn't knowable at the time, like a day's closing price for a decision made that same day. Both flatter the results.
4. Markets change. Rules tuned on ten years of a low-interest-rate bull market met 2022 and flipped from winners to losers. History only contains the market conditions it contains — the death-cross pair study shows the same signal thriving in one environment and failing in another.
Reading a Backtest Like a Skeptic
- Weigh drawdown and losing streaks over the headline return — they decide whether the plan is followable.
- Ask what the rules did in each kind of market, not just overall.
- Prefer simple rules with a reason to work over intricate ones with great numbers.
- Treat every result as a best case: reality adds costs, slippage, and your own hesitation.
- Then, ideally, paper-trade it forward — run it live with no money at risk. Fresh data is the one test overfitting can't fake, which is precisely why Ticker Coach pairs backtests with paper bots.
Key Takeaways
- Backtesting replays precise rules over history — evidence about the past, never a promise about the future.
- Its biggest gift is honest risk numbers: the drawdowns and losing streaks you'd have had to sit through.
- Overfitting, survivorship bias, ignored costs, and changing markets inflate most impressive results.
- Backtest to study a strategy; paper-trade to test it; and remember past performance does not guarantee future results — that sentence is the entire field's fine print, and it's true.