- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes V-band for watermarking numerical ensembles from autoregressive LLM forecasters. It combines keyed numerical bands, value-feedback-free digit steering, and decoy-key verification. Experiments evaluate detection, numerical-reuse robustness, forecast quality, and transfer across datasets and compatible generators.
Critical strengths
- Numerical-value watermarking is well motivated by forecast reuse operations that can disrupt token-based evidence while preserving useful numerical information.
- Decoy-key verification provides finite-sample false-positive control under explicit assumptions, accommodating dependence among forecast values. VFF additionally provides a deterministic displacement bound.
- The evaluation is extensive, covering five evaluation sets and 26 compatible checkpoints, with component ablations, numerical-space comparators, and transparent reporting of limitations.
Critical weaknesses
- The benefit of model-probability-guided insertion over simpler numerical editing is not fully isolated. Existing comparisons change both the insertion procedure and carrier configuration. An output-only baseline using the same keyed bands, editable digits, and displacement budget would better establish the contribution of conditional digit steering (Section 5.2 and Appendix H).
- The small forecasting-cost conclusion depends substantially on aggregation. At the default strength, pooled CRPS increases by 0.26%, whereas the mean per-unit relative increase is 7.41%, or 2.55% after excluding near-zero controls. Although disclosed, this heterogeneity warrants upper-tail degradation statistics and evaluation under a prespecified utility constraint (Appendix I.1).
- Forecast-quality evaluation primarily measures stepwise marginal accuracy and coverage. Since VFF conditions future predictions on unpublished control values, these metrics do not establish preservation of temporal dependence in released trajectories. A trajectory-sensitive evaluation, such as cumulative-outcome accuracy or a variogram score, would strengthen the utility assessment (Sections 3.2 and 5.1).
Questions for authors
See above.