- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes VisWave, a training-free decoder for block-diffusion vision-language models. It overlaps adjacent blocks through revisable wavefront decoding and introduces VR-T2T verification to retain or revise tokens generated under stale contexts selectively. The method reports a 1.57× average speedup on BARD-VL-4B with a 0.27pp decrease in macro accuracy, and demonstrates transfer across model scales and architectures.
Critical strengths
S1. Effective training-free acceleration. The paper addresses the serial dependency between blocks and achieves consistent wall-clock speedups without additional training.
S2. Broad evaluation and detailed analysis. Experiments cover multiple model scales, two diffusion VLM architectures, and open-ended generation. The paper also provides statistical analyses and verification ablations.
Critical weaknesses
W1. Insufficient comparison with optimized native decoding.
The default configuration uses four denoising steps for a block of four tokens (Table C1), resulting in nearly one forward evaluation per generated token (Table 1 and Figure 1a). Thus, the reported acceleration is measured against a decoder with nearly autoregressive-like sequential depth. Without evaluating alternative native configurations, such as fewer denoising steps or larger blocks, it remains unclear whether VisWave offers a better quality–latency trade-off than simpler decoding schedules.
W2. Limited practical generality of the evaluation protocol.
The main benchmarks use an Evidence-192 + Answer-8 protocol, which encourages longer generations than standard direct-answer VQA. Since VisWave primarily benefits long sequences, this setting may overstate its practical advantages. For instance, ChartQA achieves only 1.226× speedup with an 8.0% NFE reduction. A comparison with standard direct-answer decoding would better establish its practical usefulness.
W3. Limited novelty over existing block-diffusion decoding methods and unclear multimodal-specific contribution.
The core idea of VisWave is overlapping adjacent blocks and revising tokens generated under stale contexts, which closely resembles existing approaches for text-only block-diffusion LLMs, particularly FlowBlock (Tian et al., 2026). While the authors introduce VR-T2T to address the lack of native token-editing capabilities, the underlying verification mechanism appears largely modality-agnostic.
Furthermore, Section 5.3 only demonstrates that visual inputs influence verification decisions, which does not establish what challenges are unique to multimodal diffusion or why a distinct multimodal method is necessary. The absence of a direct comparison with a FlowBlock-inspired baseline makes the algorithmic novelty difficult to assess.
The additional complexity also appears insufficiently justified: Table 5 shows no accuracy improvement from adding VR-T2T (65.60 → 65.60), despite its substantial token-level verification gains. A clearer distinction from prior text-only methods and stronger evidence for the necessity of the proposed components would strengthen the contribution.
W4. Quality preservation and verification reliability require further analysis.
Despite the small average accuracy degradation, several tasks show notable drops, including MMStar (−1.87pp), SDAR-VL ChartQA (−4.24pp), and DOCCI CIDEr (11.24 → 7.67). Token agreement with native decoding is also substantially lower for BARD-VL-4B than for its 2B/8B variants.
Moreover, the visible-token verifier achieves an AUROC below chance (0.418), and the reported 87.7% draft reuse rate is based on only 219 tokens. These observations warrant further analysis of verification reliability and quality degradation.
References Tian, B., Liu, H., Zhong, X., Duan, Z., Luo, Z., Jin, H., Wang, Z., & Liao, X. (2026). FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models. arXiv:2607.17652.
Questions for authors
- How does VisWave compare with native decoding using alternative block sizes and denoising steps? Can the authors provide a quality–latency Pareto comparison?
- What are the key algorithmic differences between VisWave and existing text-only wavefront decoding approaches such as FlowBlock? Which challenges specifically arise from multimodal conditioning?
- Can the authors provide a simpler wavefront verification baseline and clarify the contribution of VR-T2T in Table 5?
3 comments
Response to Reviewer 3 (Part 2): Algorithmic Differences, Verification Baselines, and Evaluation Protocol
Q2. Algorithmic differences and multimodal conditioning
Response: VisWave and FlowBlock both shorten serial waiting by overlapping computation across adjacent blocks. The main differences lie in the draft revision mechanism and its portability. FlowBlock relies on the backbone's native visible-token editing capability. VisWave's VR-T2T instead retains the logical draft, temporarily masks candidate positions in the model input, and jointly re-predicts them using the latest context. Top-1 agreement and a support threshold determine whether a candidate is retained or remasked. Thus, VR-T2T does not require native visible-token editing, allowing wavefront execution to extend to target models that lack reliable visible-editing signals. On the BARD-VL checkpoint used in this paper, the state-matched audit shows that masked re-prediction increases verification AUROC from 0.418 for visible-token scoring to 0.942; see Eqs. 8–10 and Table F1.
Our work focuses on visual evidence generation and detailed descriptions. The core challenge is to construct reliable revision signals for visual descriptions generated early while the textual context continues to evolve. A fixed image does not imply that the draft's visual support remains unchanged: predecessor updates may change the object, attribute, or relation to which a successor token refers. Therefore, predictive support under the old context cannot directly establish validity in the new context. VR-T2T masks and re-predicts candidates under the joint conditioning of the latest text and the original image, reassesses their support, and then decides whether to retain or regenerate them; see Eqs. 9–10.
Q3. Simpler verification baselines and VR-T2T's contribution
Response: We added visible-token verification as a simple baseline and used wavefront decoding without revision as a reference. We compared different revision strategies under identical wavefront scheduling and fused-preview settings. VR-T2T verifies candidates through masked re-prediction, retains drafts that remain supported by the latest multimodal context, and returns rejected positions to native denoising. Full VisWave additionally incorporates verified prefetch. On the same 100 DOCCI images, VR-T2T achieves METEOR 17.25, exceeding wavefront without revision and visible-token verification by 2.02 and 7.76 points, respectively; see Table R3-3.
Table R3-2. Comparison of wavefront revision strategies on DOCCI
| Method | CIDEr↑ | METEOR↑ | Latency(s)↓ | NFE↓ | Tokens | Remasks |
|---|---|---|---|---|---|---|
| BARD-VL-4B | 11.24 | 17.99 | 8.200 | 253.51 | 202.80 | 0.00 |
| Wavefront w/o revision | 4.16 | 15.23 | 3.801 | 106.62 | 205.24 | 0.00 |
| Visible-T2T | 6.07 | 9.49 | 4.703 | 134.45 | 246.24 | 0.00 |
| VR-T2T | 7.67 | 17.25 | 5.037 | 141.86 | 183.16 | 36.18 |
| VisWave | 7.67 | 17.24 | 4.960 | 142.30 | 183.00 | 36.10 |
W2. Evidence protocol and practical VQA benefits
Response: VisWave primarily targets scenarios that continuously generate multiple text blocks. We use Evidence-192 + Answer-8 to separate visual evidence generation from final-answer generation and examine cross-block decoding efficiency under a common generation budget. We use VQA benchmarks because their reference answers allow us to test whether changing the decoding process preserves final task performance. This evaluation therefore measures both generation efficiency under long-evidence workloads and question-answering accuracy.We additionally use DOCCI to directly evaluate the complete generated descriptions. The corresponding quality–latency results are reported in the 300-image comparisons in our response to Q1.
Thank you for the detailed rebuttal and additional experiments. I appreciate the authors' efforts to address my concerns, particularly the new quality–latency comparisons and verification ablations.
The additional VR-T2T ablations provide useful evidence for the effectiveness of the proposed verification mechanism. However, my primary concerns regarding the practical advantage over optimized native decoding and the algorithmic novelty remain.
First, the new results in Table R3-1(a) suggest that the acceleration benefits are strongly dependent on the decoding configuration. While VisWave achieves meaningful speedups under K4/T4, simply adjusting the native block size and denoising steps yields more favorable quality–latency trade-offs on QA benchmarks. For example, Native K8/T4 achieves higher accuracy and substantially lower latency than VisWave K4/T4 on RealWorldQA. Furthermore, VisWave is consistently slower than native decoding under K8/T4 and K16/T8 across all four QA benchmarks. These results raise concerns about the practical advantages of VisWave under more efficient native decoding configurations.
Second, while the authors clarify the differences between VR-T2T and FlowBlock, the multimodal-specific algorithmic contribution remains insufficiently established. The proposed masked re-prediction strategy appears broadly applicable to text-only diffusion models as well, and the rebuttal does not provide direct evidence demonstrating its necessity specifically for multimodal decoding.
I acknowledge that the DOCCI results demonstrate consistent latency reductions for long-form generation, and that the additional ablations strengthen the motivation for VR-T2T. Nevertheless, the above concerns remain significant.
I will maintain my original rating, as the rebuttal partially addresses my concerns but does not fully resolve the questions regarding practical advantages and algorithmic novelty.
Response to Reviewer 3 (Part 1): Native Decoding Configurations and Quality–Latency Comparisons
Thank you for your careful review and constructive feedback. We have added experiments and analyses to address your concerns.
Q1. Quality–latency comparisons with alternative native configurations
Response: We supplemented our evaluation with quality–latency comparisons across different block sizes and numbers of denoising steps under the same experimental configuration. The results are presented in Table R3-1.
Compared with native decoding under different configurations, VisWave maintains competitive overall quality–latency performance.
On QA tasks, VisWave's task scores are close to those of Native under the same configuration. It achieves speedups on all four datasets at 4/4 and on three datasets at 4/2. Under the 8/4 and 16/8 configurations, the model generates only approximately 9–16 tokens on average, leaving limited computation for cross-block overlap and making the additional overhead difficult to amortize.
On DOCCI long-form description generation, VisWave further reduces latency in all four same-configuration comparisons, achieving speedups of 1.23–1.55×. In cross-configuration comparisons, VisWave K4/T2 is faster than Native K8/T4 while also achieving higher CIDEr and METEOR. These results show that, for long-description tasks, fewer steps and larger blocks can accelerate native decoding, while revisable wavefront execution provides additional acceleration for long-form text generation.
R3-1(a). Full QA evaluations with static K/T
(K/T: block length/denoising steps per block; RWQA: RealWorldQA.)
(b) DOCCI: confirmation on 300 images