- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SparseGRN, a training-free acceleration framework for Generative Refinement Networks. It combines uncertainty-based routing onset with budget-constrained query allocation using an offline response model and dynamic programming. The method reports a 1.46× speedup on GRN-2B with largely preserved generation quality.
Critical strengths
-
The paper is well motivated and clearly presented, with an overall framework and methodological description that are easy to follow.
-
Selective query updates with full KV coverage and cached output reuse form a coherent design, achieving a reported 1.46× speedup on GRN-2B with largely preserved quality and additional validation on GRN-8B.
-
The internal ablations examine routing onset, allocation policies, query budgets, and reduced-step generation, showing that dynamic allocation improves quality over constant allocation at comparable latency.
Critical weaknesses
-
Limited significance in the redundancy analysis. Temporal redundancy and heterogeneous token sensitivity are already well-established motivations for acceleration in diffusion and visual autoregressive models, including ToCa and FastVAR. The paper largely confirms these observations in GRN without clearly identifying new insights specific to its refinement process.
-
Insufficient differentiation from existing caching methods. Selective token recomputation, feature reuse, and adaptive scheduling have substantial precedent, including DP-based cache scheduling in CacheQuant and feature forecasting in TaylorSeer. Although these approaches are not identical to SparseGRN, the paper does not clearly establish which GRN-specific challenge requires its proposed design. Consequently, the technical advance beyond adapting established caching techniques remains insufficiently demonstrated.
-
The main experimental comparison does not address the paper’s central research question. Table 1 devotes substantial space to unrelated diffusion and AR backbones, whose quality differences cannot be attributed to the proposed acceleration strategy and therefore provide no evidence for its methodological contribution. For a GRN acceleration paper, the essential comparison is against relevant acceleration methods on the same GRN backbone under controlled conditions, yet such comparisons are absent. Comparing only against dense GRN and internal variants establishes that the proposed approach can accelerate GRN, but does not establish an advance over existing caching techniques. This is a fundamental gap in the experimental design, leaving the claimed methodological contribution inadequately substantiated despite the apparent breadth of Table 1.
Questions for authors
see weaknesses