Thread: Differences between backtests done by several software

Results 1 to 3 of 3

  1. #1

    Default Differences between backtests done by several software

    Does software play a significant role in the quality of the backtest? MT4 is capable of doing backtests and it is free but I am wondering if other software like Amibroker or Multicharts offer additional quality and maybe other capabilities that I cannot think of. Am I missing something while using MT4? Any info on the topic is appreciated. Thank you.
  2. #2

    Default

    When you say quality of the backtest, its only as good as the parameters or functionality of the software. I've performed manual backtests many times especially as alot of strategies are more subjective but I've tended to place more reliance on the software generated ones.
    But it needs to be realistic. Ie a backtest that takes account of overall market trend is far better than an individual backtest on one instrument. One that can also "prioritise" based on a ranking, as its highly likely you may have more than buy signal on different instruments at the same time.
    One that can backtest against a whole portfolio and one that can recognise different timeframes.
    All of these are the qualities I look for, and lastly but also just as important is one that is easy to configure. Design your own exit strategies, partial exits and scale in or out of positions
    They all play quite a large role I've found in assessing the quality of the strategy I intend to use

    On the flip side, with backtesting software there is a tendency to add more and more parameter, to get the results better, leaning to optimisation
    I never optimise, however curvefitting becomes inevitable the more you tweak something.

    But no doubt for me, software plays a large part in the ability to perform these functions
  3. #3

    Default

    Thank you for your reply malaguti.

    I don't optimize any of the parameters I do backtest on to avoid curvefitting. I plan to do forward testing to my strategies as well to measure their performance better. I just wondered whether MT4 had inferior backtesting qualities because it is free. I think MT4 cannot backtest strategies that incorporate indicators from different timeframes, but I am not sure. Maybe that is the advantage of the paid backtesters.

    Can you recommend any backtesters that are free? Any of them capable of walk-forward testing? I downloaded M1 data from a free source and would like to give my strategies a try in a free application. I am a student so anything free, I will take it

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts