- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
HammingMark accepts sentences whose semantic hashes lie near the preceding sentence's hash. This context-dependent constraint aims to preserve natural continuations while creating detectable transition statistics. Experiments evaluate detection, paraphrase robustness, quality, sampling cost, and semantic diversity.
Critical strengths
- The practical gains are substantial: 2.2 candidates per sentence versus SimMark's 8.1, strong attacked-text detection, and 94.7% semantic-diversity retention measured with a separate encoder (Tables 1, 2, and 7).
- The equal-coverage Random Code control and acceptance-matched cosine baseline help isolate the contribution of context-dependent Hamming neighborhoods (Section 4.5 and Appendix M).
Critical weaknesses
- Detection uses dataset-specific calibration on 500 negatives. Appendix J acknowledges that its proposed default threshold has no guaranteed FPR on unseen distributions. False-positive behavior on human text across domains and lengths remains insufficiently characterized for provenance use.
- Robustness is demonstrated against generic paraphrasers and rewriting, but not targeted disruption of sentence boundaries or adjacency. Since both detectors depend on adjacent sentence pairs, this leaves a relevant attack surface unresolved.
Questions for authors
- With a frozen threshold, what is the actual FPR on held-out human text across domains and document lengths?
- How much detection survives sentence deletion, reordering, or merging when output quality is controlled?
Final Follow-up on Our Rebuttal and Request for Reconsideration
Dear Reviewer,
As the rebuttal period is coming to an end, we understand your time is limited, but we would sincerely appreciate it if you could revisit our responses when you have a chance.
We have carefully addressed your concerns through clarifying PMark's actual selection rule in Figure 2, additional calibration stability and held-out FPR evaluations, and new experiments analyzing sampling costs and acceptance rates under challenging semantic transitions. These results further support the reliability and efficiency of HammingMark.
We sincerely hope these clarifications and additional results have addressed your concerns, and we would be very grateful if you could reconsider your assessment. If you have any remaining questions or suggestions, please feel free to let us know, and we will respond as promptly as possible.
Thank you again for your valuable time and consideration.
Best regards,
The Authors