Backtests Are For Losers

I know. I know. How could I possibly disparage backtesting? After all, every algo-driven quant fund in the world -- the new masters of the universe -- runs all of their strategies through rigorous backtesting.

Let’s put those guys aside for a moment, because first, they have more computing power that the Pentagon and second 90% of their “edge” has nothing to do with trading and everything to do with cheating as it is essentially a programmatic form of front running. Most of the quant world reminds me of an old Sylvester Stallone movie called Shade in which he plays a card shark. The best part of that movie is the tagline -- “When betting is your life- leave nothing to chance.” The movie is basically about very sophisticated forms of cheating much like most of quant trading.

But us mere mortal retail traders must operate in the world of risk and when it comes to retail trading let me ask you a question -- have you ever seen a backtest that was confirmed in real life trading? I have seen plenty of beautiful 45-degree equity curves that turned to mush once real money was put on the line. I have seen many, sophisticated backtest results that were put through more data torture exercises than I could possibly imagine and yet they too lost their “robustness” within months of going live.

Like my columns?
Sign up for FREE weekly delivery to your inbox.

Instead of focusing on backtests let’s look at how one of the most successful companies in the world does business. In a recent article on Amazon, here is what it said, “But Amazon doesn’t spend too much time on internal testing. “They prioritize launching early over everything else,” one engineer wrote in an epic 2011 rant comparing Amazon’s culture to other technology companies. Launching early with what Ries has dubbed a “minimum viable product” allows Amazon to learn as quickly as possible whether an idea that sounds good on paper is actually a good idea in the real world.”

This is an incredibly valuable lesson for us all. “Real Life” or in our case “The FX Market” will be the true test of our ideas. In fact, over the past three years I am proud to say that aside from a 20 or so manual samples on a chart, I have never backtested any of my strategies. In fact much to my amusement, every year traders with far more computer skill than I email me very elegant charts showing me exactly why my strategies are horrible losers -- and yet in real life we haven’t had a down year on day trades since we started in 2013 and as shown last week I closed my personal account in 2016 with 21% gain.

Why do my strategies lose in theory but win in practice?

Because I don’t care about theory, I only focus on practice. Trading is 90% tactics and 10% strategy. People who like to backtest everything have those numbers in reverse, which is why much to their consternation they inevitably lose. They spend too much time thinking and too little doing.

I would even go so far as to say that I despise backtesting because it mainly offers false hope and breeds intellectual arrogance that forces the trader to make the same stubborn mistakes over and over again.

To trade well -- take a lesson from Jeff Bezos. Prototype and then put it out into the real world. Let the market be your teacher. That’s the only test that matters.

Like my columns?
Sign up for FREE weekly delivery to your inbox.

Boris Schlossberg

Leave a Comment

Your email address will not be published. Required fields are marked *