- Joined
- 13 June 2007
- Posts
- 838
- Reactions
- 136
Surely you not saying ALL trend following systems take or SHOULD take every signal?
If so I cant DISAGREE more.
Are these tests in your book.
IE how to set them up and how to apply them?
Thanks,
Tech
If I have developed a mechanical trading system, tested and validated it, I can only expect the real-time results to approximate the out-of-sample results if I take all the signals. If I skip some signals, I have turned that system into a discretionary system. There is no way to validate a discretionary system. So, my answer depends on whether the system is mechanical or discretionary. If it is mechanical, I must take ALL the signals. If it is discretionary, I may skip whichever ones will turn out to be losers.
Yes. Statistical testing can be done using any number of observations. (Only out-of-sample observations may be used. In-sample results have no predictive value. But I've said that enough that you all know it by now.) The ability of statistical tests to differentiate between alternatives is related to the number of observations in each alternative, and to the mean and standard deviation of the observations. More observations make the decisions easier and quicker -- that is, they give an indication that a system is broken faster. It will probably take at least ten (perhaps considerably more, depending in part on the mean and standard distribution of the trades) closed trades to have reliable statistical evidence that a system is broken. But yes, the methods are explained in the book.
------
Just a point about statistical tests of trading data.
A common question to ask is "Is the mean profit (insert your own objective function in place of profit) for trading system A greater than zero?" Or, "Is the mean profit for trading system A greater than the mean profit for trading system B?"
It is not unusual for the standard deviation to be as great as, or greater than, the mean. If so, it is very difficult to have confidence that the mean is different than zero. The two-standard deviation bands around the mean include zero.
Thanks,
Howard
www.quantitativetradingsystems.com