- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes RELIC, a framework for exploiting local forensic cues that may not be adequately captured by a compact vision backbone’s global representation. It uses residual supervision from a frozen teacher, staged training, and cross-layer feature collection to construct an enhanced representation. The teacher and auxiliary guidance modules are removed at inference. The paper evaluates the approach through cross-dataset detection, downstream feature replacement, and corruption tests, examining its effectiveness, generalization, and deployment cost.
Critical strengths
- An efficient inference pathway for forensic representation learning. RELIC uses fixed teacher residual supervision and persistent inter-layer collection to produce a single Restored Token. The teacher, Residual Tokenizer, LEAD, and auxiliary readouts are discarded at inference. The forward-only measurements in Table 4, obtained under a common hardware and input protocol, provide direct support for the claimed modest inference overhead.
- Useful diagnostic evaluations. The domain-level, downstream-transfer, and corruption results report both improvements and regressions, helping establish the method’s operating limits. These analyses help identify the conditions under which the method is effective.
Critical weaknesses
- The independent contribution of the central mechanism is not sufficiently isolated. The theoretical orthogonal residual need not coincide with the calibrated training target. The final RELIC system is unmatched in Table 16, while Table 12 combines independently trained probes with the deployed classifier. These differences make it difficult to attribute the gains specifically to the proposed residual-recovery mechanism.
- Result traceability and deployment claims remain incomplete. Balanced accuracy is inconsistent with the class recalls in Tables 16–17, and the ForensicConcept summary differs between the main text and Table 7. The downstream interface mapping lacks necessary training details, while RA-Det uses per-domain optimal thresholds, limiting the scope of the plug-and-play claim.
Questions for authors
- Could the authors reconcile the balanced accuracy and class recalls in Tables 16–17, specifying the evaluation set, checkpoint, and aggregation used for each? Which ForensicConcept domain-macro results—the main-text summary or Table 7—correspond to the final evaluation protocol?
- Is a matched control available that starts from the same pre-aligned modules and differs only in whether the residual coordinates remain fixed during collector training, with the architecture, training data, and optimization budget otherwise matched?
- How is the Projected CLS + collector memory control constructed to match the stated input dimension and capacity of the probes in Table 12? Does the Restored Token’s AIGIBench advantage persist when it is evaluated using the same independent-probe training protocol as the intermediate representations?
- What are the parameterization, training objective, and training data for the RELIC-1024 mapping, and is this mapping shared across host detectors or fitted separately? How should the plug-and-play claim be qualified given RA-Det’s use of independently optimized per-domain thresholds?