- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
HyMoR-Attn proposes training-free sparse attention for video diffusion, combining a coarse Macro core with fine-grained repair of omitted interactions. It uses offline head-risk calibration, an online sampled-LSE scorer, and separate Macro/Micro kernels with an exact normalization merge. Experiments on HunyuanVideo and Wan report improved fidelity over DFSAttn at comparable or lower latency. However, the evidence does not convincingly establish the novelty or necessity of the proposed combination.
Critical strengths
-
The paper provides a concrete, testable diagnosis of omitted interactions. The add-back experiments measure recovery of attention-output error rather than relying solely on attention visualizations. Tables 5–7 distinguish average omissions from severe omissions and suggest that a small number of Microtiles can account for much of the recoverable error. This provides a useful empirical motivation for selective repair.
-
The reported improvements extend across multiple settings and are supported by targeted ablations. Evaluation covers two models, two tasks, and two resolutions. Ablations examine random tile selection, random head selection, and mean-pooled scoring. Together, these results provide preliminary evidence that selective fine-grained repair can improve the practical quality–latency trade-off.
Critical weaknesses
- Key numerical evidence is internally inconsistent. Figure 4(c) labels the online sampled-LSE scorer’s Recall@20 as 95.4%, whereas Section 4.3, the figure caption, and the corresponding row of Table 8 report 89.0%. In Table 8, 95.4% belongs to the dense-mass oracle. The plotted improvement of 82.7 percentage points also uses 95.4%, making this more consequential than an isolated typographical error. Additionally, Section 6.2.1 claims a VBench improvement of 0.07–0.11 points over DFSAttn, while Table 2 gives 0.17, 0.26, 0.23, and 0.20 points for the quality-oriented configurations. These discrepancies reduce confidence in the quantitative presentation and require reconciliation with the underlying records.
- The ablations do not adequately isolate support repair from additional computation or establish the contribution of granularity matching. In Table 3, the full method has density 0.1984, while removing the Micro residual reduces density to 0.1961. Consequently, this comparison does not strictly establish that the gain is independent of increased support. A control allocating the same additional budget to the coarse core is missing. Furthermore, the paper does not compare all-fine and mixed-granularity execution on an identical support set or ablate Macro promotion. The results therefore leave unresolved how much benefit comes from support selection versus the proposed execution strategy.
- The central “granularity trap” argument relies on an insufficiently justified fine-grained baseline. Table 1 reports 401 seconds for Tiled-16 at 20% density, compared with 315 seconds for dense attention. This establishes the inefficiency of the tested implementation, but does not demonstrate an inherent limitation of fine-grained execution. FG-Attn is cited but not evaluated, despite explicitly addressing hardware efficiency for fine-grained sparse attention.
Questions for authors
-
Result clarification: Is the sampled-LSE Recall@20 in Figure 4(c) 89.0% or 95.4%? Please reconcile the figure with Table 8 and provide the corresponding plotting data and script. Are the heatmaps in Figure 4(b) empirical measurements or schematic illustrations? If empirical, what model, layer–head, timestep, and samples produced them?
-
Implementation clarification: What are the per-row budget bounds and Macro promotion threshold? Does promotion introduce additional interactions, and how are these counted in realized density? How is support overlap avoided after promotion so that the LSE merge remains valid?
-
Evaluation clarification: What are the frame counts, total denoising steps, prompt counts, and seed counts for each setting? What statistical test and pairing unit support the significance claims? Does reported density include the 12-step dense warmup, and does end-to-end timing include scoring, selection, promotion, and merging?
-
Validation of the central claim: Does HyMoR-Attn retain its advantage over optimized FG-Attn and a coarse-core expansion control at matched density or latency? On an identical support set, how much time does mixed-granularity execution save over all-fine execution? These comparisons would materially affect my assessment of the claimed granularity-matching contribution.