- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes HuRF for detecting synthetic digital-human videos using pose-oriented representations, human-part relation distillation, and a gated temporal adapter. It also introduces HuDigivid, a dataset covering 19 generators across three paradigms, and reports strong cross-paradigm and in-the-wild results.
Critical strengths
- The evaluation covers different generation mechanisms. HuDigivid includes implicit-driven, explicitly guided, and 3D-rendered digital humans, as well as two collected in-the-wild subsets. Training only on implicit generation provides a useful test of transfer to unseen paradigms. HuRF achieves a mean AUC of 0.9160 in this setting, compared with 0.7624 for the strongest reported baseline.
- Several experiments support the complete framework. The representation comparisons, component ablations, external DigiFakeAV evaluation, and degradation tests examine different aspects of the method. The full model substantially improves over the same pose-oriented classification baseline. Its in-the-wild results also suggest that the gains extend beyond controlled generation settings.
Critical weaknesses
-
The evaluation leaves authenticity confounded with source and identity. Table A3 lists JD as the source of all controlled-test real videos, while synthetic videos use reference sources including HDTF, TikTok, DFDC, and official avatar assets. Holding out generators and real-video platforms tests distribution shift, but does not rule out reliance on source-dependent appearance, composition, or processing cues.
The paper does not clearly establish that identities and source videos are disjoint across training and testing, nor does it provide source-matched real/fake controls. The JD in-the-wild subset provides some platform overlap between classes, and the external evaluation is useful, but neither fully resolves this concern. Attention visualizations alone cannot show that background shortcuts have been removed. This is particularly relevant because reducing such shortcuts is a central motivation for HuRF.
-
The ablations do not isolate the benefit of adaptive temporal calibration. TAC extends an existing spatiotemporal adapter, but the ablation removes the entire TAC module. This tests temporal adaptation as a whole, rather than the learned gate specifically. A comparison with the underlying adapter using a fixed gate , with the same backbone and two-stage training schedule, would help establish what the gate adds.
The large gap between end-to-end and two-stage training is also difficult to interpret without matched optimization budgets and repeated runs. No uncertainty estimates are reported. These are especially relevant for the smaller gains in cross-generator evaluation, where AUC increases from 0.9140 to 0.9164, and on DigiFakeAV, where it increases from 0.8519 to 0.8594.
Questions for authors
- Are identities, original recordings, reference images, and driving videos disjoint across training and testing? Please describe the validation split and explain how checkpoints, representation layers, and hyperparameters were selected without using the Shared Test Set.
- Do the gains persist in source-matched real/fake comparisons or after controlled foreground/background replacement?
- How does HuRF compare with the underlying spatiotemporal adapter using a fixed gate , under the same backbone and training schedule? Do the learned gates vary across generation paradigms as the motivation predicts?
- Please report the training budget for each stage and for the end-to-end comparison, along with variability across training seeds. Total trainable parameters and inference cost would also help assess the cost of the temporal modules.