- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper asks whether an out-of-distribution (OOD) signal that uses no learned representation can improve position sizing (not direction) in trend-following. It constructs T1, a k-nearest-neighbour Wasserstein-2 distance between the current day's trailing return window and its k nearest training analogues in a four-dimensional, train-only-standardised condition-feature space, and passes it through a train-calibrated sigmoid gate that can only shrink a standard volatility-scaled magnitude. The mechanism is evaluated on 15 liquid instruments in five asset classes under walk-forward validation, cluster-robust bootstrap, hyperparameter / direction-signal / evaluation-window / transaction-cost sweeps, and against eleven competing gating scores, all under a perturbation-verified causal-timing protocol. The headline claim is a drawdown reduction (13/15 instruments, mean −6.42 pp; 68/75 walk-forward folds) with explicitly no Sharpe improvement, plus two reported tensions (calibration coverage vs. drawdown benefit; portfolio decorrelation vs. benefit) and a Lean 4 formalisation of the paper's elementary mathematics.
Critical strengths
- Freezing a non-learned direction signal across every magnitude comparison, and pre-registering ΔMDD as the single primary test, makes the ablation family genuinely interpretable.
- The eleven competing gates share identical machinery and the paper reports where each one wins (Mahalanobis 14/15, energy distance best MDD, CUSUM the only gate with non-negative mean Sharpe).
- Verification discipline exceeds the norm: every signal passes a perturbation-based causal-timing test, the Lean scope is stated honestly, and the six-variant DMN failure is reported as a negative result.
Critical weaknesses
- The entire economic case is a drawdown-only effect with no Sharpe benefit (0/15 survive the Deflated Sharpe Ratio) that largely disappears once the gate correlation producing it is removed (+0.307 vs +0.157; 9.95% → 15.14%).
- T1 rests on a stationarity assumption its own coverage check refutes (33.1% exceedance vs 10% nominal), leaving it an arbitrary member of a gate class in which CUSUM, Mahalanobis, energy distance and MMD are equally competitive.
- Execution realism is only partly handled: turnover rises 1.52×, the benefit decays from 13/15 at 5 bps to 8/15 at 50 bps, and no spread, slippage or market-impact model is used.
- The Lean formalisation verifies only elementary statements on which none of the empirical claims depend, while generative AI was used to "create or modify" figures, so the plotted numbers cannot be verified from the paper.
- The evidence base is narrow (15 yfinance instruments, 2–3 per asset class, crypto only from 2020) and the headline negative result rests on an unverified DMN reimplementation at a single data scale.
Questions for authors
- The entire economic case is a drawdown-only effect with no Sharpe benefit (0/15 survive the Deflated Sharpe Ratio) that largely disappears once the gate correlation producing it is removed (+0.307 vs +0.157; 9.95% → 15.14%).
- T1 rests on a stationarity assumption its own coverage check refutes (33.1% exceedance vs 10% nominal), leaving it an arbitrary member of a gate class in which CUSUM, Mahalanobis, energy distance and MMD are equally competitive.
- Execution realism is only partly handled: turnover rises 1.52×, the benefit decays from 13/15 at 5 bps to 8/15 at 50 bps, and no spread, slippage or market-impact model is used.
- The Lean formalisation verifies only elementary statements on which none of the empirical claims depend, while generative AI was used to "create or modify" figures, so the plotted numbers cannot be verified from the paper.
- The evidence base is narrow (15 yfinance instruments, 2–3 per asset class, crypto only from 2020) and the headline negative result rests on an unverified DMN reimplementation at a single data scale.
Dear Reviewer dpt3,
Because of the discussion periods will close soon. Dont know if my comments have solved all your concerns ?
Thank you again for your time and thoughtful feedback.