Statistical gates reduce false positives but limit strategy adoption rates
On the Boundary of Admission Gates: An Injected-Truth Study of Falsification-First Selection in Quantitative Strategy Research
Artificial IntelligenceComputational Engineering, Finance, and Science
Summary
Finding successful strategies can be tricky because sometimes a rule looks good by chance rather than real value. The authors study 'admission gates,' which are rules to decide if a strategy is really good or just lucky. They find these gates work well to stop false findings when signals are weak, but they also reject most strategies, allowing only 1-7% to pass. Interestingly, some common methods wrongly reject all strategies, even the true ones.
What this means in practice
- •For quantitative finance teams: Use admission gate criteria proven to reduce false positive trading strategies in weak signal environments while understanding adoption rate trade-offs.
- •For financial risk management teams: Improve assessment of backtested trading rules by distinguishing true predictive skill from search luck using injected-truth tests.
Authors
Tianlun Zheng
Abstract
Strategy research conflates two problems: finding a profitable rule, and establishing that the finding is not search luck. The latter calls for admission gates -- statistical criteria that must be satisfied before a conclusion is adopted -- yet whether gates work, and at what cost, remains untested. We introduce an injected-truth protocol with a random-admission control that adopts at the same rate as the gate; only if the gate beats this control does it carry information rather than merely raise a threshold. Across synthetic and real-calibrated panels, gates eliminate false discoveries in the weak-signal regime but cut adoption to 1--7%, and add nothing when signals are strong. Most importantly, criteria computed on absolute rather than excess returns silently reject every candidate, including true signals. Keywords: multiple testing, backtest overfitting, strategy admission, injected-truth validation, excess returns, false discovery rate