- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
DSA (Dense Signal Augmentation) modifies group-relative RL by adding a progress signal to returns before group normalization, with a success-dependent weighting schedule. The paper provides theoretical analyses of the operator and evaluates it through four paired training runs, operator controls, and comparisons with ProGPO variants.
Critical strengths
The paper explicitly acknowledges the inconclusive primary test and distinguishes evidence for task improvement, mechanism, distinctiveness, and deployability. The predeclared evaluation protocol is a positive aspect of the work, although it does not compensate for the limited empirical findings.
Critical weaknesses
-
The primary paired test is inconclusive (p = 0.125, four run pairs), and DSA does not demonstrate superiority over matched-budget ProGPO variants. The consistently positive results rely on a non-deployable oracle planner, while the learned proxy remains exploratory. Thus, the practical benefit of the proposed operator is not convincingly established.
-
The core idea is relatively simple, but extensive custom terminology and overly detailed explanations make the paper difficult to follow. Redundant elements, such as the repeated "measured" status in Table 2, add complexity without improving clarity. The presentation obscures the main contribution and makes the empirical evidence harder to assess.
Questions for authors
-
With only four run pairs, the exact one-sided sign-flip test has a minimum attainable p-value of 0.0625. How was this evaluation designed to provide sufficient statistical power?
-
Given the comparable gains of ProGPO variants, what evidence supports a distinct advantage of DSA? Could you provide uncertainty estimates for these comparisons?
-
What are the quantitative fidelity and task-performance results for the deployable history-aware proxy? Do they support the practical effectiveness of DSA?
5 comments
Official Response to Reviewer jPVy (Part 2/3)
About History-Aware Signal Fidelity and Applicability
What are the quantitative fidelity and task-performance results for the deployable history-aware proxy? Do they support the practical effectiveness of DSA?
E4 history-contrast NRMSE is 0.707 [0.620, 0.787], centered R² is 0.500 and rank concordance is 0.691 [0.657, 0.728]. Contrast minus global NRMSE is -0.172 [-0.235, -0.103]. E5 calibration lowers contrast NRMSE to 0.665 while preserving rank. E6 task-balanced fitting further lowers calibrated NRMSE to 0.517; its rank difference from unweighted fitting is 0.051 [-0.012, 0.118].
D1 reports contrast cosine 0.750 [0.695, 0.807] and relative standardized error 0.500 [0.386, 0.610]. Its relation to reconstruction error is explained by the equal-energy condition in the D1 response.
These scores improve on the constant predictor's NRMSE=1 and tie rank=0.5. Reconstruction error, ordering and standardized direction describe complementary aspects of progress-signal quality.
For task performance, the original Table 7 learned-history proxy reaches the threshold at a median 67.5 updates versus 75.0 for GiGPO, with final success 56.64% versus 52.73%. Table 7 reports task-training outcomes for the original predictor; E4–E6 report reconstruction, calibration and objective-alignment results for the specified history-based predictors. Fitting uses planner labels, while frozen inference requires only causal history.
Official Response to Reviewer jPVy (Part 3/3)
About Presentation and Terminology
The core idea is relatively simple, but extensive custom terminology and overly detailed explanations make the paper difficult to follow.
The central definition is:
“Within each inherited comparison group, add progress measured before the action to return, then standardize once.”
The simplicity provides an attribution advantage: progress placement can change while the inherited grouping rule and optimizer stay fixed, and disabling augmentation supplies an exact elementwise control on the same collected rows. This makes the interface directly testable without introducing a new comparison rule.
The replies use this definition and the direct scientific questions: whether training improves, whether this operator helps beyond the stated controls, and whether a usable progress signal exists. Algebra identifies when coefficients change; held-out training evaluates utility; predictor specification defines signal availability.
We will simplify the presentation around this definition, remove repeated status labels from tables, and shorten the terminology and explanations around the main comparisons.
Official Response to Reviewer jPVy (Part 1/3)
About Statistical Power and Comparative Utility
DSA adds action-before progress to the inherited return, then standardizes once within the inherited group. The disabled identity and fixed comparison rule make the intervention explicit, while the analysis characterizes return–progress coupling and temporal alignment.
The original four-pair study has one-sided exact sign-flip resolution 0.0625. The separate E1 extension uses 32 independent pairs and retains the 20/128 attainment endpoint: the mean gain over GiGPO is 9.844 updates [5.537, 14.151], with exact p=4.375e-05. Final success also improves by 4.932 percentage points [3.723, 6.140] as a secondary endpoint.
For the closest-method comparisons, the submitted Appendix C.2 reports gains of 3.750 ± 12.500 updates against Yang (mean ± sample SD; exact p=0.375) and 6.250 ± 12.500 against the paper-derived Fan–Liu implementation (p=0.250). E2 additionally compares controlled operators: mean early gains are 7.500/12.500/11.250 over dead-only/RMS-matched separate/return-stratified controls. The E2 dead-only interval is [-2.771, 17.771]. These comparisons report the observed effect and paired uncertainty under each protocol.
The contribution is the combine-before-standardization operator, its exact disabled-baseline identity, and the controlled comparisons of scale, activation and signal placement.