- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes AsymRefresh, a training-free method for speeding up joint audio-video generation. Existing caching methods skip computation on most sampling steps and periodically run full “joint” refreshes that recompute both modalities. AsymRefresh adds a third option: selective steps that recompute only the audio while predicting the video output.
To keep audio conditioned on the evolving video, a shallow joint prefix (1–2 blocks) runs at every step. Deeper audio blocks attend to video context reconstructed from the two most recent full refreshes. Output prediction uses the existing DiCache predictor.
The method is evaluated on JavisDiT++ (JavisBench, 10,140 prompts; T2AV-Compass, 500 prompts) and JavisDiT (T2AV-Compass), against TeaCache, PAB, TaylorSeer, and DiCache. On JavisBench, it achieves a 1.93× speedup over the unaccelerated model with quality comparable to the baselines. Controlled studies on 512 prompts and three seeds show that, at matched latency, audio-only updates improve audio–text alignment (CLAP) slightly more than extra joint refreshes. Late-stage updates outperform middle-stage ones. These gains come with small drops in some video and audio quality scores and about 2.5 GiB of additional memory. All evaluation uses automatic metrics.
Critical strengths
- Clear, simple idea. Treating “which modality to recompute” as a budget choice is easy to grasp and offers a new option for speeding up joint audio-video generation. It’s also training-free, so it works with existing models without retraining.
- Transparent reporting. The authors report all metrics, including unfavorable ones, plus per-seed results and inconclusive findings. They clearly label which results are exploratory or tuned on observed data. This openness is what makes the weaknesses easy to identify.
- Matched-budget comparison. The key experiment compares audio-only updates against extra full refreshes at nearly the same speed, with the predictor held fixed. This directly tests the paper’s central question, even though the measured gain is small.
Critical weaknesses
No human subjective evaluation
The main gains are very small, around +0.001 to +0.004 on CLAP. Without a listening test, we don’t know whether anyone could actually hear a difference.
Novelty
The paper’s main idea is to recompute only the audio on some caching steps, while predicting the video, instead of always refreshing both modalities together. Framing modality choice as part of inference-budget allocation is clear and reasonable. However, the individual components are largely borrowed:
- The output and context predictor is taken directly from DiCache (Bu et al., 2026).
- Modality-asymmetric computation, where video is reused and audio recomputed, appears in SyncCache (Ma et al., 2026).
- Audio attending to cached video context appears in H3 AudioRefine. The distinct contribution is applying this asymmetry during joint sampling, where both modalities are still evolving. This requires the shallow joint prefix and the reconstruction of video context from anchors. That is a genuine technical adaptation, but an incremental one in my opinion.
Small Gains Obscure the Contribution of the New Components
The novelty concern is amplified by the size of the reported benefit. The gains over extra joint refreshes are small (+0.0007 to +0.0035 CLAP). The main-benchmark results are largely indistinguishable from DiCache, and the paper’s own ablation could not show a benefit from context extrapolation, the component most specific to the new setting. As a result, it is unclear whether the new elements, beyond DiCache plus an audio-only schedule, contribute meaningfully. I would encourage the authors to:
- state more precisely what is new relative to SyncCache and H3 AudioRefine,
- show a case where the joint-sampling-specific design (prefix plus reconstructed context) clearly matters.
No synchronization measurement
The method’s goal is keeping sound tied to the video, but the sync metric (DeSync) was dropped because the clips are too short. There’s no direct evidence that timing between sound and picture is preserved.
Settings tuned on the test data
The T2AV operating points were picked after looking at benchmark results, and the authors call them exploratory. The follow-up test on new prompts found no clear advantage, and those prompts were written by AI with no human review.
Weak timing evidence.
Speed is measured on only 4 prompts and 3 repeats. For JavisDiT, the Native timing comes from a different setup (concurrent runs), so its speedup isn’t a fair comparison. The speed advantage over DiCache is also small (17.68 s vs 18.00 s on T2AV).
Quality and memory costs.
Some video and audio quality scores drop (VQ, MQ, PQ), and memory use rises by about 2.5 GiB, roughly 15%.
Narrow scope
- Only short clips (~4 seconds) are used.
- Only audio-only refreshes are explored. The reverse, video-only refreshes, is never tried.
- The method is compared only to other caching tricks, not to fewer-step samplers or distilled models, and it isn’t tested in combination with them.
I am willing to increase the score if the weaknesses can be addressed.
Questions for authors
See critical weaknesses.