- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper revisits Temporal Forgery Localization (TFL) by highlighting its key differences from Temporal Action Localization (TAL) and adapting the model architecture accordingly. The authors propose DiST-TFL, a Diffusion-guided Sparse Temporal Forgery Localization framework that jointly addresses forgery-sensitive representation learning and sparse temporal localization. Experimental results on two benchmark datasets demonstrate the effectiveness of the proposed approach.
Critical strengths
- The paper highlights the differences between Temporal Forgery Localization (TFL) and Temporal Action Localization (TAL), particularly the subtle forgery cues and sparse temporal distribution of manipulated segments. This provides a reasonable motivation for revisiting existing localization architectures.
- The proposed method achieves substantial improvements in mAP on both LAV-DF and AV-Deepfake1M compared with the reported baselines, demonstrating its effectiveness on established audio-visual forgery localization benchmarks.
Critical weaknesses
- The proposed framework relies on concatenated audio-visual features extracted by AV-HuBERT. However, its core components, including diffusion-guided feature refinement and sparse query-based localization, do not explicitly model cross-modal interactions. It would be valuable to evaluate the framework under visual-only and audio-only settings to better understand the contribution of each modality and whether the proposed architecture remains effective with single-modal inputs.
- The experiments are conducted only on LAV-DF and AV-Deepfake1M, both of which focus on audio-visual forgery localization. Since the proposed framework is not inherently restricted to audio-visual inputs, evaluating it on the visual-only ActivityForensics benchmark would help demonstrate its generalizability to different forgery localization settings. Furthermore, a direct comparison with TADiff on this benchmark would provide stronger evidence for the effectiveness of the proposed diffusion-guided design over existing diffusion-based approaches.
Questions for authors
Please refer to weakness part.
Response to Q1: Fairness of Baseline Comparisons.
We thank the reviewer for highlighting the importance of a feature-controlled comparison. To address this concern, we have additionally reproduced DiMoDif and RegQAV using the same AV-HuBERT input features as DiST-TFL and the other baselines, while retaining their respective model architectures and training configurations.
During the rebuttal period, we also identified an oversight in our original LAV-DF experiments: a portion of the extracted LAV-DF features had inadvertently been omitted when training DiST-TFL. To ensure experimental rigor and fairness, we retrained DiST-TFL using the complete LAV-DF feature set and updated the corresponding results. Consequently, its mAP on LAV-DF increases from 93.13% to 94.996%.
Under the unified AV-HuBERT features, DiMoDif achieves mAP scores of 74.85% and 56.15%, while RegQAV achieves 77.28% and 51.81% on LAV-DF and AV-Deepfake1M, respectively. DiST-TFL continues to achieve the highest mAP on both datasets (94.996% and 84.17%). Importantly, AuViRe remains the second-best method on both benchmarks, with mAP scores of 87.24% and 73.97%. Therefore, DiST-TFL maintains improvements of +7.76 and +10.20 percentage points, respectively, under the unified feature setting.
Regarding RegQAV and DiMoDif, both methods rely on specialized feature representation strategies. RegQAV introduces register-enhanced representation learning to improve audio-visual feature modeling, while DiMoDif employs independently pretrained Visual Speech Recognition (VSR) and Audio Speech Recognition (ASR) encoders to capture cross-modal speech discrepancies. We initially retained their originally reported results out of concern that replacing these specialized representations with unified AV-HuBERT features might affect their distinctive feature modeling mechanisms and potentially influence their performance.
Compared with the originally reported results, RegQAV's mAP on AV-Deepfake1M decreases from 56.66% to 51.81% (-4.85 points), although it increases from 69.90% to 77.28% (+7.38 points) on LAV-DF. For DiMoDif, the original paper does not report mAP, so we compare [email protected] instead. Interestingly, DiMoDif's [email protected] improves from 95.50% to 98.26% (+2.76 points) on LAV-DF and from 86.93% to 96.46% (+9.53 points) on AV-Deepfake1M. Nevertheless, we have now reproduced both methods under the unified AV-HuBERT feature setting to provide a more controlled and transparent comparison.
We have updated Table 1 and Table 2, their corresponding descriptions, and the experimental protocol in Section 4.2 to reflect the corrected LAV-DF results and the additional baseline experiments. All modifications are highlighted in blue in the revised manuscript. The corresponding updated checkpoint will also be provided in the revised supplementary materials.
Overall, these additional experiments confirm that DiST-TFL maintains its performance advantages under a feature-controlled comparison.