- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes WOSpec, a method that integrates Gumbel-max watermarking with online speculative decoding. The key contribution is Watermarked Gumbel-max List Sampling (WMGLS), which uses exponential order statistics to construct a multi-draft coupling that preserves the exact watermarked output regardless of draft model updates. By combining this coupling with existing online draft training, the method improves decoding efficiency while maintaining stable watermark strength. Experiments on Llama-2 and Vicuna models demonstrate higehr sampling efficiency and throughput.
Critical strengths
The reverse construction of draft sampling randomness is a neat idea. By leveraging the properties of exponential order statistics, the authors design a coupling that preserves the exact Gumbel-max watermarked output while retaining the sampling efficiency of multi-draft speculative decoding.
Critical weaknesses
-
Unclear novelty and contribution. The main technical contribution is not entirely clear to me. While the reverse construction is a neat idea, the overall approach seems quite similar to existing work, especially Watermarkable Multi-Draft Speculative Sampling via Poisson Processes (arXiv:2609.21858), which already studies multi-draft coupling with watermark preservation. Also, the online draft setting feels more like a natural extension rather than a core technical contribution, since the proposed coupling already works for arbitrary draft models. Without a direct comparison to MPFR, it is hard to see how much additional value this method brings.
-
Limited generality and practical applicability. Although the authors present WOSpec as a framework, the proposed method is specifically designed around Gumbel-max watermarking. There are many other watermarking methods, such as Google's SynthID-Text, and the proposed approach is hard (or impossible) to extend to them. This makes the method more like a specific solution for Gumbel-max watermarking rather than a general framework, which limits its broader practical applicability.
Questions for authors
My biggest concern is the novelty and contribution of this work. As I understand it, the core idea seems quite similar to existing work such as MPFR, while the online draft setting feels more like a natural extension rather than a new technical challenge. Am I missing any key technical differences or contributions? I would appreciate it if the authors could clarify what makes this work fundamentally different from prior methods.
3 comments
Novelty and Comparison to MPFR (continued)
-
The online dimension and its criterion. We formalize the requirement (Definition 1: the committed text does not depend on the draft) and show that MSE fails it. For a draft independent of the decoder randomness, its watermark strength depends on the draft: the loss in expected token score relative to PFR is at most , and the constant is tight (Proposition 1). Under online training, this independence assumption need not hold, and MSE's watermark strength can change as the draft is updated, as observed in Figure 3(c), while the committed watermark of PFR and WMGLS remains unchanged under matched target, key, and fallback conventions. Our SynthID-Text experiments show a similar empirical distinction (W2).
-
Strength and efficiency together, online. A single draft at the strength end (PFR) keeps the watermark but has a lower acceptance rate. WMGLS stays at the strength end and recovers efficiency with several drafts and online training: its AATPS is 0.26–0.38 higher than that of MSE, with the ANLPPT of PFR (Table 1), and within 0.01 of unwatermarked GLS on Llama-2-7B-chat and Vicuna-13B. Under draft–randomness independence, WMGLS also reproduces the conditional GLS proposal law (Proposition 2(i)); its comparable efficiency under online training is supported empirically.
-
What carries over to a draft trained on its own watermarked outputs. The pathwise identity (Proposition 2(ii)) holds for any update rule under matched target, key, and fallback conventions. The acceptance analysis of conditional GLS (Proposition 2(i)) assumes a draft independent of the decoder randomness, which training on same-key responses can violate, so we measure online acceptance directly. On 100 held-out prompts (3 seeds, six target–workload settings), the final online draft decoded by WMGLS with fresh keys is within 0.032 AATPS of the same draft decoded by GLS. With the deployment key, WMGLS is higher by 0.105 and 0.140 on Vicuna-7B GSM8K and Code, respectively, and differs by at most 0.030 in the other settings; with the template contexts masked, the difference on Vicuna-7B GSM8K and Code is within 0.003.
-
A system into which keyed couplings plug. The WOSpec online serving-and-learning framework can accommodate different compatible watermark-preserving multi-draft couplings. In particular, MPFR can be integrated by replacing a single coupling function and, under matched conventions, preserves the same pathwise watermarked output while using the same online training loop and detector.
Generality beyond Gumbel-max, and Summary
Weakness 2: Generality and Practical Applicability
We agree that WMGLS is specific to watermarks built on an exponential (Gumbel-max) race, which is the watermark of Aaronson and Kirchner (2023) used by the work on watermarked speculative sampling that we build on (Hu and Huang, 2024; He et al., 2026). Two parts of the work are not tied to it: the online loop and system, and the online dimension of the strength--efficiency trade-off. To check both, we integrated the two speculative constructions for SynthID-Text (Dathathri et al., 2024), a high-detectability one and a fast one, into our system; only the draft rule and the detector change. Both use one draft, our online loop, the same EAGLE-3 head and training as the paper, and the opening masking of Appendix D. The detection rate uses a threshold calibrated to a 1% false-positive rate on unwatermarked GLS responses:
| Vicuna-7B, GSM8K, over 2 seeds, 100 chunks | AATPS, chunks 1–20 → 81–100 | Detection at 128 tokens | Mean -value (change in standard errors) |
|---|---|---|---|
| SynthID-High | 1.162 → 1.241 | 60.2% → 58.6% | 0.5252 → 0.5247 () |
| SynthID-Fast | 1.172 → 1.255 | 37.1% → 31.8% | 0.5186 → 0.5166 () |
Both constructions run in our system and become faster with online training. SynthID-High, whose committed token has a law that does not depend on the draft, keeps its mean -value along the stream within noise, as PFR does for the Gumbel-max watermark. SynthID-Fast commits draft-dependent tokens, and its target-key mean -value and detection rate change as the draft is trained, as MSE does. The online dimension of the trade-off is therefore not specific to Gumbel-max.
What is specific is how WMGLS resolves it. SynthID-High, like PFR, keeps the watermark with a single draft, and its AATPS over the stream (1.215) is close to that of PFR (1.220) and well below that of WMGLS at (1.546; same streams, seeds and keys, opening-masked). WMGLS recovers the efficiency with several drafts because the exponential race allows a multi-draft coupling whose committed token is the target's keyed race. A multi-draft coupling for the SynthID tournament is an interesting future direction.
Summary
We sincerely thank the reviewer again for the constructive comments and valuable suggestions, which have helped us strengthen both the contributions and empirical evidence of our work.
In response, we have addressed the two main concerns:
-
Novelty, contributions, and MPFR: We have clarified the distinct contributions of WOSpec relative to the contemporaneous MPFR work. Furthermore, following the reviewer's suggestion, we have implemented MPFR within our online serving-and-learning framework and conducted direct comparisons, demonstrating that our framework is more general and can accommodate different watermark-preserving coupling schemes.
-
Generality, practical applicability, and SynthID: We have extended our investigation to SynthID-Text, demonstrating the applicability of our online framework beyond Gumbel-max watermarking and further examining the trade-off between watermark strength and speculative efficiency.
We hope that our clarifications, additional analyses, and new experiments adequately address the reviewer's concerns. We would be very grateful if the reviewer could kindly reconsider their evaluation in light of these new results.
Thank you again for your time and consideration!
Novelty and Comparison to MPFR
We thank the reviewer for the review and for recognizing the reverse construction as a neat idea.
Before addressing the questions, we would like to respectfully clarify that MPFR (arXiv:2609.21858) is contemporaneous work, first made available on arXiv on September 18, 2026, around the submission of WOSpec. According to the ICLR 2027 Reviewer Guidelines (FAQ on contemporaneous work), authors are not required to compare against contemporaneous or arXiv-only papers, and the absence of such comparisons should not itself be grounds for rejection.
Nevertheless, we appreciate the reviewer's suggestion and have now implemented MPFR in our online framework and conducted a direct comparison, showing comparable sampling efficiency and watermark preservation.
More importantly, we would like to emphasize that WOSpec and MPFR make distinct contributions. While MPFR develops a multi-draft coupling based on Poisson processes, WOSpec studies watermark preservation under online draft updates and introduces WMGLS through a reverse exponential order-statistics construction. Furthermore, our online serving-and-learning framework is compatible with different watermark-preserving coupling schemes, including both WMGLS and MPFR, as demonstrated by our new experiments. Thus, the online framework and its analysis provide contributions beyond any particular list-coupling algorithm, and compared to MPFR, our contribution is orthogonal.
We believe that these theoretical and empirical contributions provide independent value beyond the contemporaneous MPFR work. We will further clarify their relationship and the specific novelty of WOSpec in the revised manuscript.
We now respond point by point as follows.
Weakness 1: Novelty and Contribution
As we stated above, although MPFR is contemporaneous work and orthogonal to our contribution, we nevertheless incorporated it into our online learning framework and compared its performance with our original scheme.
We integrated MPFR into our online learning framework of WOSpec by replacing only the multi-draft coupling module. The implementation follows Algorithm 4 of the MPFR paper and matches it on 3000 random cases. A ll other settings follow the WMGLS experiment (same initial draft, training recipe, prompts and seeds):
Under matched conventions, MPFR commits the same keyed token as WMGLS, and its ANLPPT equals that of WMGLS in our runs (0.0082). Its AATPS is higher by 0.002-0.006 in each seed. We therefore do not claim that WMGLS is a better coupling than MPFR. Instead, our experiments demonstrate that the online framework of WOSpec is compatible with both coupling schemes, without changing the online training procedure or watermark detector. This makes our contribution (a unified online, watermarked speculative decoding pipeline) even stronger.
Are key technical differences missing?
The committed token is the same, so the technical difference lies in how the drafts are generated. MPFR takes the first arrivals of the same keyed clocks under q. WMGLS splits the watermark minimum among the active drafts, so that each draft keeps the proposal law of conditional GLS (Proposition 2(i)). The acceptance of WMGLS can therefore be compared directly with unwatermarked GLS on the same draft, whereas MPFR has its own proposal law, which has no unwatermarked counterpart.
What is fundamentally different from prior methods, and is the online setting only a natural extension?
The reviewer is right that a drafter-invariant coupling works for any draft, and this is the property the online setting needs. What the online setting adds is the question of which methods have it, and what the others lose. Hu and Huang (2024) show that, for a fixed single draft, a watermarked speculative method keeps either the watermark strength (PFR) or the acceptance rate (MSE), not both. Under online training the draft changes after every chunk, so the trade-off gains a dimension: how the strength and the efficiency of a method change as its draft is updated. Our contributions follow this dimension.