- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SAFE-Align uses image-text similarity to condition a gate over global, local, and text-only evidence for multimodal manipulation detection. A bidirectional patch-token branch handles grounding. The method reports improved detection and manipulation-type recognition on DGM4.
Critical strengths
-
Using image-text alignment to guide evidence fusion is a reasonable idea, motivated by the observation that semantic consistency alone does not establish authenticity.
-
The method improves detection and manipulation-type recognition over the reported baselines on DGM4. Ablations against uniform fusion and an unconditioned gate provide evidence that alignment conditioning is useful.
Critical weaknesses
-
The evaluation is limited to DGM4. Although the paper covers four tasks, they all use the same dataset. There is no evaluation on another dataset or unseen manipulation sources, leaving the generality of the approach untested. Results are averaged over three runs, but no standard deviations are reported.
-
The paper lacks comparisons with the latest methods, such as MaLSF [1] (CVPR 2026). Without these comparisons, SAFE-Align’s competitiveness against recent advances remains unclear.
-
The main motivation is not directly tested. The gate ablations support an overall benefit, but the paper does not report performance separately for weakly aligned authentic pairs and strongly aligned manipulated pairs, or show how routing weights change across alignment levels.
-
The grounding results are mixed. Text F1 is lower than ASAP (75.73% vs. 76.52%), and image [email protected] is lower than UFAFormer (76.38% vs. 79.20%). Although the grounding components improve over their ablated variants, their advantage over existing methods is less convincing than the detection gains.
[1] Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, and Xiangru Yin. Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 26561-26571, 2026.
Questions for authors
- Can you provide results on another dataset or unseen manipulation sources to assess generalization beyond DGM4?
- How does SAFE-Align compare with recent methods?
- Does alignment-conditioned routing improve performance specifically on weakly aligned authentic pairs and strongly aligned manipulated pairs? Can you show how routing weights vary across alignment levels?
5 comments
The authors' rebuttal has been submitted
Dear reviewer, this is a kind reminder that the authors have posted their responses to your reviews. Please review their rebuttal, engage in any necessary follow-up discussion with the authors, and confirm whether your concerns have been addressed by updating your review/scores. Thank you for your colaboration.
Thanks for the detailed response and the great ablations for Q3! However, is there really no way for the authors to add just one more dataset, such as Weibo17 or Weibo21? I totally understand they don't satisfy all the requirements of your full framework, but they can still serve as a nice validation experiment, right? For example, you could simply remove the bbox detector&loss and just test the core routing/detection part. Honestly, relying on a single dataset makes it really tough to justify accepting this paper to the main conference.
Response to Reviewer H4Ua
We thank the reviewer for recognizing the motivation for alignment-guided fusion. The revision adds recent baselines, three-run standard deviations, direct tests of the motivating alignment regimes, controlled routing ablations, and grounding-error analysis. These additions strengthen the evidence for sample-dependent evidence aggregation.
Q1: Generalization beyond DGM4 and run-to-run variability.
A1: The revised evaluation strengthens the DGM4 evidence through three independent runs across all 12 metrics and targeted analysis of different correspondence regimes. Table 1 reports AUC 95.63±0.69%, ACC 88.74±1.91%, mAP 89.63±0.41%, and IoU50 91.73±1.50%. Table 5 additionally uses identical seeds (333, 555, 777) across four controlled configurations.
The alignment-stratified experiments test challenging cases within DGM4, including authentic pairs with weak correspondence and manipulated pairs with strong correspondence. Full improves performance in both cases, as detailed below. Cross-dataset and unseen-source generalization remain to be evaluated; the revised conclusions identify DGM4 as the current empirical scope.
Q2: Comparison with recent methods, particularly MaLSF.
A2: We have added MaLSF and EMSF to Table 1:
SAFE-Align achieves the highest reported AUC, CF1, and IoU50 among these methods. Compared with the stronger MaLSF value for each metric, its CF1 and IoU50 improve by 0.95 and 2.78 percentage points, respectively. Against EMSF, the gains are 0.52 AUC, 1.28 CF1, and 3.38 IoU50 points.
These results establish competitiveness against recent advances, particularly in class-wise manipulation recognition and moderate-overlap localization. Table 1 also reports the remaining metrics: EMSF achieves higher mAP, and MaLSF achieves higher strict grounding accuracy. Baseline results retain their original-paper provenance.
Q3: Does routing improve the specific alignment regimes motivating the method?
A3: Yes. Table 7 directly evaluates these cases in one matched run:
With the direct alignment-feature path retained, routing improves TNR by 7.37 points and TPR by 27.89 points. Without direct injection, routing also improves both metrics. This directly supports the motivation: correspondence strength informs evidence interpretation without determining authenticity.
Full also achieves the highest AUC in every alignment stratum:
The strongest gains occur in Levels 2–3. The strongly aligned manipulated subset contains 104 samples.
Table 5 provides complementary three-seed evidence: routing improves mean AUC by 0.67 points without direct injection and 0.97 points with it. Table 8 reports branch-wise discrimination by alignment level. These diagnostics evaluate branch effectiveness; routing-weight summaries remain a separate analysis.
Table 10 further tests the alignment representation. Combining continuous similarity and discrete states achieves AUC/ACC/mAP of 95.13/90.06/89.90%, improving over the respective stronger single-signal control by 0.90/0.50/0.65 points.
Grounding performance and error analysis.
SAFE-Align’s IoU50 exceeds UFAFormer by 6.34 points (91.73% vs. 85.39%), demonstrating higher localization success at moderate overlap. Table 9 examines 3,427 predictions below IoU 0.75: small-region errors and partial coverage occur in 65.80% and 46.13%, respectively, with overlapping categories. Figure 12 illustrates how incomplete coverage and boundary displacement reduce strict overlap.
We also corrected text F1: Table 1 now reports precision 76.51±0.34%, recall 74.48±1.51%, and F1 75.48±0.60%. The revised conclusions distinguish detection and moderate-overlap localization strengths from the remaining challenges in boundary precision and text F1.
We thank the reviewer again. To support reproduction, we will release the implementation, configurations, and trained weights after the double-blind review period, with the repository link in the final manuscript.