- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes CAVC (Convergence-Adaptive Audio-Visual Cache), a training-free inference acceleration method for audio-video diffusion models that selectively caches the audio branch during denoising because audio errors appear easier to recover than video errors. Existing acceleration methods generally assume that all components can be cached or skipped in a similar manner. The hyphothesis is audio and video modalities exhibit asymmetric recoverability during diffusion denoising. The proposed method (CAVC) divides the denoising process into three phases: 1) normal joint denoising, 2) audio caching phase, and 3) recovery phase. Though these approaches, the proposed method could recover from modality-asymmetric problems. The method is evaluated on an audio-video diffusion model derived from the LTX-Video ecosystem with approximately 10%–35% inference acceleration and improvement on the benchmarks.
Critical strengths
-
Well-motivated empirical observation. The paper identifies a potentially interesting phenomenon: errors introduced by caching the audio branch appear substantially more recoverable than errors introduced by caching the video branch. This observation is supported by diagnostic branch-freezing and branch-caching experiments and provides a clear motivation for the proposed method.
-
Practical training-free acceleration. CAVC can be applied directly to pretrained audio-visual diffusion models without retraining, additional fine-tuning, or architectural modifications. This makes deployment straightforward and increases practical applicability in real-world inference pipelines.
-
Simple and easy-to-implement proposed method. The method consists of a relatively lightweight modification to the sampling process involving audio caching and a terminal recovery phase. The implementation complexity is low compared with methods requiring new training objectives or specialized architectures.
-
Comprehensive ablation studies. The paper includes several ablations investigating cache intervals, convergence thresholds, and recovery schedules. These experiments help clarify the contribution of different design choices and improve the reproducibility of the method.
Critical weaknesses
-
Limited novelty relative to existing diffusion caching methods (Major Concern). The core idea appears closely related to prior diffusion acceleration methods such as DeepCache, TeaCache, AdaCache, ToCa, and PAB. These methods already exploit temporal redundancy and selectively reuse computations during diffusion sampling. CAVC mainly applies this principle at the modality level (audio branch) rather than introducing a fundamentally new caching mechanism.
-
Missing important baseline. The most important missing experiment is an audio-only version of TeaCache (or another adaptive caching method) combined with the same terminal recovery stage. Without this comparison, it is difficult to determine whether the improvement stems from the claimed modality-asymmetric recoverability or simply from applying existing caching techniques selectively to the audio branch.
-
Insufficient evidence for the claimed scientific phenomenon. The central claim of "modality-asymmetric recoverability" is demonstrated only on a single model family. The paper does not establish whether this phenomenon generalizes to other audio-visual diffusion architectures, datasets, or modality balancing strategies. As a result, the proposed principle may be architecture-specific rather than fundamental.
-
Modest acceleration gains. The reported speedups are relatively limited compared with other diffusion acceleration approaches such as distillation, step reduction, consistency models, or aggressive caching methods. Since video computation remains largely intact, the achievable acceleration appears inherently constrained.
-
Quality trade-offs are not fully resolved. Although some metrics improve, others degrade noticeably. In particular, quality and naturalness metrics show non-negligible drops in certain settings. The paper therefore does not fully demonstrate a clear Pareto improvement between quality and efficiency.
-
Lacking of deeper analysis of cross-modal interactions. The paper argues that video information must remain active while audio can be cached, but the underlying reasons for this asymmetry remain unclear. A stronger analysis of cross-modal information flow would make the claims more convincing.
Questions for authors
- Is the contribution fundamentally different from TeaCache/AdaCache?
- Can we compare with the baseline in the weaknesses?
- How general is the "modality-asymmetric recoverability" phenomenon? For instance, does this observation hold for other audio-video diffusion architectures?
- What is the underlying cause of the asymmetry? The underlying problem is not explained. Is it due to stronger video-to-audio conditioning?
- Why are the speedups relatively modest?
Rebuttal Acknowledgement
We thank the authors for providing a rebuttal addressing the concerns raised above. Although the rebuttal partially resolves some of these concerns, several issues remain, as below:
Some other points for consideration:
Given the remaining concerns, we maintain the current rating.