- Rating
- 2
- Confidence
- 4(+1)
- Informativeness
- 1
- Presentation
- 2(−1)
- Soundness
- 2
Read review
Paper summary
SinkMark uses attention-sink-induced hallucinations as behavioral fingerprints to identify vision-language models and their modified derivatives through black-box queries.
Critical strengths
-
Novel fingerprinting mechanism: Turns attention-sink-induced hallucinations into model-specific signals for black-box ownership verification.
-
Robustness without permanent model changes: Preserves fingerprint signals across several fine-tuning and compression settings while leaving the released model unchanged.
Critical weaknesses
-
White-box probe construction: Probe construction requires access to model internals and gradients. Although verification is black-box, probe construction with only API access to the protected model is not demonstrated.
-
Limited evaluation: Only two source models are tested, with insufficient analysis of verification query budgets and false-positive rates.
Questions for authors
How to apply the method on models without clear or stable attention sinks?
2 comments
Follow up comment
Several critical concerns remain unresolved and need to be addressed before I can reconsider my recommendation.
-
The additional model does not adequately address the concern about evaluation coverage. Your new model MiniGPT-4 dates back to 2023. While the manuscript also evaluates Qwen2.5-VL, adding another legacy model does little to establish relevance to current VLMs. For an ICLR 2027 submission, can the authors evaluate at least one representative model released in 2026, including its modified derivatives? Attention-sink behavior, visual processing, and susceptibility to adversarial perturbations can differ substantially across model generations. These differences are particularly relevant here because the proposed method explicitly depends on inducing specific internal attention behavior. The response acknowledges that induction may fail, but provides no evidence establishing when or why. Increasing the model count does not, by itself, resolve the applicability concern.
-
The new query-budget experiment does not sufficiently establish reliable ownership verification. The reported zero false positives come from repeatedly subsampling a fixed pool of 200 probes on only four negative-control models. These trials characterize that particular pool and model set. They do not establish reliability across independently constructed fingerprints or a broader population of unrelated models.
-
I additionally noticed substantial degradation under routine deployment changes. E.g. 4-bit quantization reduces TMR from 98% to 21%.
Given these unresolved concerns, I believe the paper, in its current form, falls substantially short of the standard required for acceptance at ICLR. I therefore maintain my rejection recommendation (2: weak rejection, leaning towards 1) if no additional justifications. Please prioritize these additional experiments.
Response to Reviewer: Access Assumptions, Evaluation, and Applicability
Thank you for the constructive comments.
Q-1. White-box probe construction: Probe construction requires access to model internals and gradients. Although verification is black-box, probe construction with only API access to the protected model is not demonstrated.
RESPONSE: We agree: SinkMark requires white-box source access for construction and does not demonstrate API-only construction. The intended user is a publisher with access to the protected checkpoint, checking whether a suspicious black-box service derives from it.
Construction uses source hidden states, attention weights, and gradients to optimize private image-text probes (Sections 4.1-4.2). Temporary parameter updates are discarded, leaving the released model unchanged. Verification uses only the suspicious model's input-output interface (Section 3.2).
Section 6 explicitly states this limitation. Commercial models in Appendix A.10 are unrelated negative controls, not evidence of API-only construction. Extending construction to API-only access remains future work.
Q-2. Limited evaluation: Only two source models are tested, with insufficient analysis of verification query budgets and false-positive rates.
RESPONSE: We add a third source model, query-budget experiments, and empirical false-positive rates on four unrelated models.
Additional model. Appendix A.9/Table 7 evaluates MiniGPT-4 with LoRA and full fine-tuning on four tasks. SinkMark has the highest TMR in five of eight settings; AGDI or SIF leads in the remaining three. All results are reproduced below.
Query budgets. Appendix A.11/Figure 17 uses a fixed pool of 200 probes, a fixed seed, and 100 random-subset trials per budget, Q∈{1,5,10,20}. A trial is positive when its TMR meets ηQ=1/Q. The source has 100% detection at all budgets. Across eight derivatives, detection ranges from 17-68% at Q=1 and 73-100% at Q=5; seven reach 100% at Q=10, and all eight at Q=20.
False positives. The same protocol evaluates Qwen2.5-VL-3B-Instruct, Qwen2.5-VL-7B-Instruct, MiniGPT-4-Vicuna7B, and InstructBLIP-Vicuna7B. Each yields 0/100 positive trials at every budget, complementing the unrelated-model TMR results reported in Table 1. These are empirical rates for these models and this fixed pool, not guarantees for arbitrary unrelated models.
MiniGPT-4 TMR (manuscript Table 7). L/F denote LoRA/full fine-tuning. Task order: MathV, PaintingForm, TextVQA, V7W. Bold marks column maxima.
Figure location: Revised manuscript, Appendix A.11, Figure 17, PDF p. 22. Left: source/derivative detection rates. Right: four unrelated-model FPR curves overlapping at 0%. Each budget uses 100 trials; the threshold is ηQ=1/Q.
Q-3. How to apply the method on models without clear or stable attention sinks?
RESPONSE: SinkMark selects a candidate and attempts to induce sink-like behavior; it does not require an initially strong sink. Section 4.1 uses cross-layer hidden-state similarity (Eq. 8), following Mirage, to locate a potential aggregation position. This is a selection heuristic, not an attention-concentration measurement. The attention objective encourages attention to the position, while consistency aligns cross-layer candidate distributions (Eqs. 13-15). Binding and post-sink induction associate it with the target hallucination (Eqs. 9-10).
Successful induction is not guaranteed: construction may fail if optimization cannot establish attention concentration and target association. Section 6 states that effectiveness on architectures where these patterns cannot be induced, or with substantially different attention mechanisms, remains unverified. This is an applicability limitation, not architecture-independent robustness.