- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose an efficient inference framework for Effect-aware Video Object Removal. Sparsity-Driven Distillation (SDD) combines dense attention in the real score model with sparse attention in the fake score model, exploiting their score discrepancy to guide few-step student distillation. Meanwhile, Pixel Reconstruction Loss (PRL) decodes the predicted denoised latents into RGB videos using a frozen VAE decoder and enforces pixel-level supervision against ground-truth videos. Beyond removing specified objects, the framework also eliminates associated visual effects, such as shadows, reflections, and illumination changes, even when they extend beyond the input mask.
Critical strengths
- Removing an object and its associated effects, such as shadows, aligns with human intuition. Through architectural and training innovations, FastEraser leverages Sparsity-Driven Distillation (SDD) and Pixel Reconstruction Loss (PRL) to retain effect-aware removal capabilities without requiring additional effect-region masks, while substantially reducing inference costs, demonstrating practical value.
- FastEraser achieves a substantial improvement in inference efficiency over EffectErase with 50 inference steps, reducing the DiT inference time from 86.0 seconds to just 4.6 seconds and significantly lowering the computational cost.
Critical weaknesses
- As shown in Table 1, FastEraser exhibits degraded temporal consistency across all benchmarks. Temporal consistency is particularly important in video tasks, as frequent flickering can lead to a very poor user experience. What causes this degradation, and how can temporal consistency be improved?
- FastEraser reduces the teacher model's denoising steps from 50 to 4. Would increasing the number of steps to 8 or 16 help maintain temporal consistency?
- Tables 4 in the main paper and Table 6 in the appendix both compare auxiliary losses. Why do they report different metric combinations and results?
- In Table 3, why does SDD outperform the Teacher (50 steps) baseline? What accounts for this improvement?
- In Figure 3, “Oberservation” is misspelled.
Questions for authors
Please refer to the Weaknesses.