- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents an empirical study of the interaction between complete-module SACA fusion and lip-region reconstruction supervision in a GaussianTalker-based system. A 2×2 factorial experiment covers three identities and three seeds, followed by a single-seed, lip-supervised comparison on fifteen additional identities. The results show a supervision-dependent reversal in the average synchronization ranking of SACA and Mean, heterogeneous effects across identities, and synchronization gains frequently accompanied by reduced mouth reconstruction fidelity. Supplementary records support analysis-level reproduction.
Critical strengths
- The core experiment provides a clearly defined comparison. The complete 2×2 design, paired seeds, and identity-level aggregation allow the fusion–supervision interaction to be estimated within the core study. This makes the conditional configuration effects explicit.
- The reporting is transparent. Identity-resolved results, negative examples, sensitivity analyses, and archived measurements make the reported variation and limitations relatively easy to inspect.
Critical weaknesses
- The fusion comparison provides limited insight into spatial-query routing. In Section 3.5, No-SACA uses LayerNorm applied to the sum of the spatial feature and the averaged condition tokens. It therefore retains spatial conditioning while replacing the complete SACA module, changing condition weighting, feed-forward computation, and active capacity together. The comparison supports a complete-module effect, but does not identify which of these changes accounts for the observed interaction. This limits the explanatory insight provided by the study.
- The additional identities do not replicate the central interaction. The complete fusion-by-lip-supervision comparison covers only three identity–video instances. The fifteen-identity extension evaluates Full versus No-SACA with lip supervision enabled, leaving the corresponding lip-off comparisons unavailable. The extension therefore broadens the evidence for heterogeneous lip-on effects, but does not establish whether the fusion–supervision interaction extends beyond the three core instances.
- The synchronization–reconstruction trade-off remains insufficiently characterized. Section 4.4 shows that synchronization gains often coincide with lower mouth PSNR under the evaluated loss weights. However, the supplementary weight variations do not compare both fusion branches at matched supervision strengths. The results establish this co-occurrence at the reported settings, but leave unclear whether the relative reconstruction cost persists after adjusting the lip-loss weight. This limits the guidance provided on choosing between the two fusion configurations.
Questions for authors
Please prioritize the controlled fusion comparison in Question 1 and the evaluation clarification in Question 4. Questions 2 and 3 describe targeted extensions that would strengthen the assessment, if feasible within the rebuttal period.
- Controlled fusion comparison. Does the interaction persist when adaptive attention is replaced with uniform weights while retaining the value/output projections, FFN, residual connections, and normalization? As an exploratory rebuttal check, this control could be evaluated on the three core identities at seed 1, with lip supervision on and off, requiring six additional runs. Please report the LSE-D/LSE-C conditional effects and interactions relative to the corresponding Full configurations.
- Extending the factorial evaluation. If feasible, could the factorial comparison be completed for three additional identities selected using a stated criterion independent of their observed Full–No-SACA gains? Adding the two missing lip-off configurations at seed 1 would require six additional runs. Do the identity-level interactions retain the directions observed in the core study? If this evaluation is unavailable, please explain what evidence supports extending the interpretation of the interaction beyond the three core instances, or explicitly restrict that interpretation to the core study.
- Matched lip-supervision weights. The supplement includes SACA results for May/seed-1 with lip-loss weights of 0.2 and 0.8. Could the corresponding Mean configurations be evaluated, allowing both branches to be compared at weights of 0.2, 0.4, and 0.8? Please report synchronization and mouth reconstruction metrics to assess whether the observed trade-off persists across these settings.
- Synchronization evaluation protocol. For Kjell, Tables 6 and 14 both report Full/seed-1 results on 238 frames, but give different LSE-D/LSE-C scores: 14.432/1.020 and 14.053/1.095, respectively. What accounts for this difference? Please clarify whether the checkpoint, rendered inputs, audio, face processing, or scorer settings differ, and provide the ground-truth synchronization scores under the same evaluation protocol.