- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a new watermarking method called CrossMark that combines token-level logit bias, local-unit hash filtering, and learned global semantic categories within a shared candidate pool. During the watermark detection step, these multi-level statistics are aggregated to enable a more robust detection. Experiments on natural-language and code generation evaluate detection and output quality, with ablations of the generation and detection components.
Critical strengths
- Combining local hash evidence with token weighting and semantic filtering is an interesting approach to handling insertion and rewriting. The ablations provide useful evidence of the different roles of these components.
- Table 3 includes detection-only controls evaluated on identical outputs, which help assess the benefit of the proposed interactions beyond simply adding three independent scores.
Critical weaknesses
- The proposed method is not fully specified. Equation (2) in the Appendix lists six training losses without their mathematical definitions or weights. The main text is somewhat abstract and less explicit about the overall watermarking procedure.
- The baseline comparisons need more clarification. The application of ACW to natural-language data is unexplained, and the token-only ablation performs substantially worse than WLLM despite the same stated token strength.
Questions for authors
-
The semantic-clusterer training needs a bit more detail. Since this component is central to rewriting robustness, the authors should provide the exact definitions and weights of the 6 loss components in eq(2), together with the projection/category-head architecture and optimization settings. The verbal descriptions in Appendix A.5 and the training curves in Appendix E are insufficient to reproduce the learned representation.
-
It is a bit unclear which ACW method and implementation were used. The cited ACW method applies transformations to source code after generation, whereas Tables 1–2 report results on C4 and Figure 2 includes a watermark-strength sweep. Please clarify how it was adapted to natural language and which parameter was varied.
-
The token-only ablation also needs more clarification. On C4, Table 3 reports a token-only AUROC of 0.884, whereas WLLM achieves 0.9658 in Table 1, although Appendix A.3 describes standard red–green watermarking and Table 4 specifies . Please explain any differences in decoding, candidate selection, or scoring, since this gap affects how the contribution of the additional components should be interpreted.
Importance of hallucinated references and inquiry of elaboration on the review
Dear Reviewer kz8a,
I agree with the reviewer that hallucinated and incorrect references are crucial and even this can be considered as a desk-reject reason in some other conferences. Those two references have both wrong author names and the second paper title is incorrect. Nevertheless, I was not able to find the explicit reason to reject this paper.
Would you elaborate more on the "limited technical contribution?" Otherwise, after reading author's response, please leave your remained concerns.
AC