- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses occlusion robustness in lip synchronization by recasting occluder recovery as selective appearance transport. The proposed OAT mechanism, trained with pose-aligned identity pairs, selectively transfers occluder features without leaking reference mouth shapes. Experiments on standard and occlusion-specific benchmarks confirm substantial gains in occluder preservation while maintaining competitive lip-sync quality.
Critical strengths
-
The manuscript is well-written and the motivation is clear.
-
The Occlusion Adaptive Transport (OAT) and pose-aligned identity conditions effectively prevent ground-truth mouth leakage during training.
-
The novel occlusion-specific protocol and the OCC-E metric ensure fair assessments without target data leakage.
-
The experimental results and the supplementary demo exhibit a substantial and convincing margin of improvement over SOTA baselines.
Critical weaknesses
-
The framework relies on a two-stage pipeline where Stage-II supervision depends on pseudo identity images generated by a frozen Stage-I model. This design tightly couples the final occlusion robustness to Stage-I's disentanglement capacity, making the system vulnerable to error propagation and artifact accumulation.
-
While the proposed OCC-E metric effectively quantifies frame-wise, pixel-level reconstruction accuracy within the occluded region, it is inherently a spatial measure. It lacks temporal awareness and fails to capture potential temporal flickering or structural inconsistencies of the occluder across video sequences.
Questions for authors
How does OR-Talk quantitatively compare against recent methods such as KeySync? Without these comparisons, the claim of SOTA robustness remains unsubstantiated.
My concerns have been addressed. I appreciate the author adding a further comparison with KeySync. The author provided a breakdown of frame processing times in comparison to KeySync, which makes the tool seem promising. I will keep my score.