- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies timestep-dependent importance-ratio instability in Flow-GRPO. Starting from equal-covariance Gaussian transition kernels, it characterizes the conditional log-ratio distribution through a scalar policy displacement, termed path variance. It distinguishes the centering and variance scales under mean-reduced log probabilities and proposes LambdaNorm-T calibration combined with damp-only timestep weighting. Experiments include tiny-SD3 diagnostics and reward optimization on SD3.5 and FLUX.
Critical strengths
S1: The paper addresses a relevant optimization problem. Connecting timestep-dependent ratio behavior to quantities available from the transition kernel could provide useful diagnostics.
S2: The distinction between full and mean-reduced log probabilities is practically important. The corresponding Gaussian moment calculations are sound for a fixed pair of policies evaluated on old-policy transitions.
Critical weaknesses
W1:Novelty and budget justification remain unclear. GRPO-Guard’s Eqs. (7)–(8) already establish the Gaussian expansion and analytic centering. The additional calibration and damping may contribute, but the ESS interpretation of the proposed budget lacks a derivation accounting for latent-dimension scaling.
W2: Missing component ablations make it difficult to isolate the effects of calibration and damping. Table 6 does not demonstrate consistent budget satisfaction, and the OCR/CER confidence intervals in Table 2 require clarification.
Questions for authors
Q1: What precisely is new beyond GRPO-Guard’s existing analysis and normalization?
Q2: How does the budget imply retention target (q), including dimension factors, and how is Table 6’s overspending explained?
Q3: Can the authors provide matched component ablations and clarify the OCR/CER definitions and bootstrap intervals in Table 2?