- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether target-task improvements under disjoint supervision arise from auxiliary labels or changes to the target architecture. It proposes architecture-preserving label ablations that retain the coupling module while removing auxiliary supervision. The testbed combines spatial and temporal deepfake localization using frozen visual features, separate annotation sources, and cross-task attention. An exact single-task baseline tie supports an operational decomposition of the observed gain into architectural and label-dependent components.
Critical strengths
- Clear attribution framework. Section 3.2 identifies the confounding between auxiliary supervision and architectural changes, then provides an operational decomposition with a testable baseline identity. This makes the proposed control straightforward to interpret and reuse.
- Complementary mechanism controls. Table 2 and Figure 2 combine label removal, shuffled masks, frozen attention, parameter matching, and a single-task attention readout. Together, these experiments show that substantial gains survive without mask supervision and help distinguish label dependence from feature-access benefits.
Critical weaknesses
- The writing has a strong AI-generated tone. For example, the captions of Tables 1 and 2 are very long and overly detailed—typical of AI writing. This paper requires extensive rewriting to improve readability.
- The experimental portion is insufficient; there are only two tables and one figure.
- I do not fully understand the paper's idea. Do the limitations of existing work, as described in the paper, actually exist? The paper claims that studies of transferability between two tasks must control for shared parameters—i.e., only when the parameters trained for the two tasks are identical can one conclude that true transferability exists between tasks. Existing studies did not control for parameter sharing, so they can only suggest that improved performance on one task may be due to a better model design rather than genuine transferability between tasks. I question whether this limitation actually exists; can the authors provide detailed references to demonstrate that this is indeed a real limitation?
- The paper uses only the FaceForensics++ and AV-Deepfake1M datasets for the study; for the hypothesis being proposed, two datasets are insufficient. Multiple algorithms, model architectures, and datasets should be used to validate the hypothesis.
Questions for authors
See Weaknesses
Response to weaknesses
W1 — AI-generated tone; long captions; rewriting
We take this seriously; the density you describe is ours to fix. We rewrote, simplified, and restructured some of the main text, captions, and charts (with moving some details to the appendix with pointers) as described in the general comment.
W2 — two tables and one figure
The main text carries two tables and two figures (Figure 1 the setup, Figure 2 the per-seed controls) because the nine-page limit put the evidence in the appendix: 58 numbered tables give every per-seed level, paired difference and interval. The revision adds Table 2a to the main text. It gives the label ablation in one row per setting: three frozen encoders, two budgets, two learning rates, two mask-loss weights, a mean-pool readout, the second dataset pair, two fine-tuning recipes and one end-to-end system. The mechanism controls (shuffled masks, frozen attention, parameter matching, a single-task attention readout) are in Table 2 and Figure 2, and the discussion-period runs are in Appendices A.1–A.3.
W3 — does the limitation exist? references
The limitation we claim is narrower than the paraphrase. We do not say that parameters must be identical for transfer to exist. We say: when a coupling module and an auxiliary loss are added together, the gain over separate heads cannot be credited to the auxiliary labels unless the labels are removed with the module kept, because the module alone changes what the target head can compute (Section 3.2, Equation 1). The revised introduction states the question in one sentence: what the auxiliary labels add once their module, data and training budget are held fixed (Section 1).
Published work does make the label reading without that control, and the revised Appendix A.7 quotes where. OmniFD (Liu et al. 2025, Section IV-C) writes that tasks with fine-grained annotations "provide detailed supervision that facilitates knowledge transfer", and UVIF (Section V-C1) reads its image-plus-video row as "showing the benefit of fine-grained image annotations". In each case the labels are added together with their data, head or task.
Table 47 (Appendix A.7) documents, paper by paper from each paper's own ablation tables, that no cited system reports this control under a frozen backbone. OmniFD removes tasks together with their data, module kept. MTPSL (Li et al. 2022) removes the cross-task loss together with its mapping network. NexusFlow (Lin et al. 2025) removes the module with both label partitions kept. Knowledge Assembly (Spinola et al. 2023), named in the revised Section 2, removes one task's labels with its images kept, but under a shared backbone trained end to end, so its contrast is the whole label effect, not the two-term split. The nearest control is Zamir et al. (2020), whose frozen random constraint networks in a loss-side coupling are the analogue of our frozen-module arm.
Whether the limitation matters is what the paper tests. In an OmniFD-style module, the gain a reader would credit to mask labels survives their removal at every seed (86% at pilot; Table 2), which the coupled-versus-separate comparison cannot reveal. We do not claim that the cited systems' gains are architectural, only that their reported comparisons cannot tell (Appendix A.7).
W4 — two datasets; more algorithms, architectures, datasets
The hypothesis is tested in several blocks, each separately: three frozen encoders (OpenCLIP ViT-B/16, DINOv2 ViT-B/14, an ImageNet ResNet-50), two training pairs with FaceForensics++ masks (AV-Deepfake1M segments; TVIL segments, Table 27), two budgets, five seeds at pilot, and learning-rate and mask-loss-weight sweeps. The ordering repeats in each: the label-free arm is above naive at every seed on all three encoders, both budgets and both pairs. Algorithms: feature-space attention, output-space consistency in two formulations, and cross-dataset pseudo-labelling (Appendix A.6), plus one end-to-end system (OmniFD's recipe retrained on our pair, Appendix A.7). Four datasets (TVIL, DF40, OpenForensics, AV-Deepfake1M++) are also used as zero-shot readouts. We agree that this establishes the counterexample for one domain and one coupling family over frozen features, not a law of multi-task learning. The paper claims the former (abstract, introduction, Section 7). A general-vision pair is the natural follow-up and is future work.