- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes an action-selection rule that penalizes disagreement among the mean predictions of frozen distributional critics. It establishes deterministic properties and a conditional regret bound, and evaluates the method through portfolio backtests and matched-critic ablations.
Critical strengths
I appreciate the frozen deployment protocol and matched-critic ablation. Keeping the critics fixed is a meaningful control: it makes it easier to see whether a gain comes from the action-selection rule or from better value estimation.
Critical weaknesses
-
The methodological contribution and theoretical justification are limited. The method combines familiar ideas from distributional RL, ensembles, and pessimistic action selection, while several theoretical properties follow directly from the proposed envelope. My main concern is Assumption 1: it supplies the central link between ensemble disagreement and prediction error, without a nonvacuous residual bound for the stated training procedure. Critics can agree while sharing substantial bias. I do not see what in the analysis rules out this possibility or makes the uncertainty penalty reliable in the intended setting.
-
The empirical evidence is too weak. In Section 5.4, the matched comparison against ensemble-mean selection shows an average advantage of 0.36 percentage points and wins in only three of five repeats. These repeats share the same market history and primarily assess training randomness, so they do not give me much confidence in a dependable advantage across market conditions. The benefit of distributional critics over matched scalar critics is also unclear. In my view, the empirical evidence is too weak for this paper to be seriously considered for acceptance.
Questions for authors
- What justifies Assumption 1 for the actual training procedure? Can the residual be independently bounded or calibrated when ensemble members share systematic errors?
- Which controlled result establishes a benefit over matched scalar critics using the same extractor? How do the three wins in five repeats support the claimed reliability?