- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work achieves SOTA gains in image and video generation with some conceptual novelty but suffers from insufficient core innovation, limited practical value ,and weak experimental evidence.
Critical strengths
None
Critical weaknesses
-
Weak innovation : The work only optimizes scheduling on top of existing Taylor feature prediction, with no new mechanism. The Taylor-error-based risk proxy is simple and non-generalizable, only working for Taylor prediction .
-
Low practical deployment value: ARCS adds extra inference overhead using cached anchors. It has higher latency than SpeCa/CG-Taylor under the same compute budget. Tedious threshold and order tuning are required
-
Insufficient experiments: Some baselines lack order-matched comparisons. Ablations only validate the proposed proxy without systematic module/parameter studies. Tests are limited to DiT, FLUX and Hunyuan; stability at extreme acceleration rates is unproven.
-
Incomplete paper: Limitations like absent error propagation modeling are only briefly mentioned with no in-depth analysis. Future work is vague and lacks concrete directions, resulting in poor paper closure.
Questions for authors
see above
4 comments
Response to Reviewer ew7k (W3-W4)
W3: Experimental Comparisons, Ablations, and Evaluation Scope
Order-Matched Comparison
Tables 1 and 2 report results using the configurations recommended by the respective baseline methods, while additional order-matched comparisons are provided in Appendix B.4.
However, we acknowledge that these comparison settings were not sufficiently clarified in the main text and that an order-matched comparison with SpeCa on DiT-XL/2 was missing. The reviewer's comment prompted us to re-examine our comparison settings and identify this missing experiment, and we appreciate the opportunity to address this omission.
To address this concern, we conducted additional order-matched experiments with SpeCa on DiT-XL/2. The results are summarized below.
| Configuration | Max. order | Base threshold | NFC | FID ↓ | sFID ↓ | IS ↑ |
|---|---|---|---|---|---|---|
| SpeCa default | 4 | 0.2 | 11.0 | 2.69 | 5.21 | 231.34 |
| SpeCa order-matched | 2 | 0.2 | 11.0 | 2.70 | 5.27 | 231.72 |
| SpeCa default | 4 | 0.3 | 8.6 | 3.36 | 6.35 | 218.41 |
| SpeCa order-matched | 2 | 0.3 | 8.4 | 3.52 | 6.75 | 216.92 |
| SpeCa default | 4 | 1.0 | 5.9 | 8.55 | 8.46 | 153.34 |
| SpeCa order-matched | 2 | 1.0 | 5.9 | 9.19 | 10.45 | 152.14 |
We will incorporate these additional results into the revised manuscript and clarify the comparison settings.
Ablation Studies
Beyond the error-proxy comparison presented in Section 4.3, Appendix B provides additional analyses of the proposed components and parameter configurations.
Specifically, Appendix B.1 investigates sensitivity to the threshold schedule parameter, Appendix B.2 evaluates the contributions of progressive forecasting order and cross-order risk normalization, and Appendix B.3 compares module-level risk aggregation strategies, including Mean, Max, and RMS.
These analyses are presented in Tables 4–6 of Appendix B.
Therefore, our ablation studies are not limited to validating the proposed risk proxy; they also examine the major components of ARCS and its parameter choices.
Evaluation Scope and Aggressive Acceleration Regimes
We selected DiT-XL/2, FLUX.1-dev, and HunyuanVideo to evaluate class-conditional image generation, text-to-image generation, and text-to-video generation, respectively.
These models have also been used in prior diffusion acceleration studies, including TaylorSeer, SpeCa, and RFC. Building on these established evaluation settings, we evaluate ARCS across three distinct generation tasks.
Furthermore, Tables 1 and 2 include operating points where full computation is performed only 6.0 times (12.0%) on DiT-XL/2, 7.1 times (14.2%) on FLUX.1-dev, and 6.1 times (12.2%) on HunyuanVideo, out of 50 sampling steps.
These budgets are even lower than the most aggressive settings evaluated in RFC, namely 7 NFC on DiT, 8 NFC on FLUX, and 7 NFC on HunyuanVideo.
Therefore, our evaluation covers not only moderate acceleration settings but also aggressive computational budgets comparable to, or more constrained than, those considered in prior diffusion acceleration studies.
W4: Error Propagation and Future Research Directions
We agree that ARCS does not explicitly model error propagation throughout the denoising process.
However, error propagation is an inherent challenge shared by feature forecasting-based diffusion acceleration methods. Our work focuses on determining when full computation should be performed under a limited computational budget, despite this underlying challenge.
Regarding future research directions, Section 5 explicitly identifies the following three directions:
- Extending error-derived scheduling to other forecasting formulations.
- Incorporating error propagation into risk estimation.
- Developing online threshold adaptation for sample-specific computational budget control.
In particular, extending ARCS to other forecasters would require analyzing the approximation-error structure of each forecasting formulation and deriving a corresponding risk proxy that can be estimated from cached feature histories. While the current implementation focuses on Taylor forecasting, the underlying principle of using approximation-error-derived risk to guide Full/Forecast scheduling is not inherently restricted to Taylor-based methods. This would allow the scheduling framework to be extended to other forecasting formulations, provided that suitable risk proxies can be derived.
We hope these clarifications and additional experimental results help address the reviewer's concerns and better communicate the contributions and scope of our work.
We would be glad to provide further clarification and address any additional questions the reviewer may have.
Feedback
Thanks for your rebuttal. Some of my questions have been addressed. But I am still concerned about Novelty. I tend to reject this paper. I decide raise my score from 1 to 2.
Thank You for Your Feedback and Reconsideration
Thank you very much for taking the time to carefully reconsider our rebuttal and for acknowledging that some of your concerns have been addressed.
We sincerely appreciate your thoughtful feedback and your willingness to reconsider the rating. We also hope that our responses have helped better communicate the motivation and contributions of our work.
Thank you again for your valuable time and consideration, especially given your busy schedule!
Response to Reviewer ew7k (W1-W2)
We thank the reviewer for their feedback and for the opportunity to clarify our contributions and address the concerns raised.
As discussed in Section 2, existing feature forecasting methods, including TaylorSeer, primarily focus on how accurately intermediate features can be predicted under limited computational budgets. In contrast, our work addresses a complementary but distinct question: When should these predictions be trusted, and when should full computation be performed?
The key contribution of ARCS is deriving a scheduling signal from the approximation-error structure of the underlying forecaster. Unlike existing adaptive scheduling methods that rely on feature-change estimates or separate validation signals, ARCS determines when to perform full computation using a risk proxy derived from approximation error.
Specifically, we formulate Taylor forecasting using Newton divided differences under irregularly spaced computation anchors and derive a risk proxy from cached feature history. We further introduce progressive forecasting order to accommodate limited anchor history and cross-order risk normalization to maintain comparability of risk scores across different prediction orders. These components enable adaptive Full/Forecast decisions without additional network evaluations for risk estimation.
Therefore, our methodological contribution is not the introduction of a new predictor, but rather establishing a connection between forecasting reliability and computation scheduling through approximation-error analysis.
We acknowledge that the current implementation of ARCS focuses on Taylor forecasting. However, the underlying principle of deriving scheduling signals from a predictor's approximation-error structure is not inherently restricted to Taylor-based methods.
Extending this approach to other predictors would require deriving an appropriate error proxy for each forecasting formulation, as explicitly discussed in Section 5 (Limitations and Future Work). We identify this extension as a promising direction for future research.
Latency and Generation Quality
We acknowledge that ARCS exhibits higher latency than SpeCa and CG-Taylor on DiT-XL/2. However, as shown in Table 1, the latency overhead relative to SpeCa is approximately 11.9% at 11 NFC, whereas it decreases to approximately 4.4% and 6.2% at the more aggressive 8-NFC and 6-NFC operating points, respectively.
Notably, at 6 NFC, although ARCS incurs approximately 6.2% higher latency than SpeCa, it reduces FID from 8.55 to 5.17, representing a 39.5% improvement, while increasing IS from 153.34 to 200.09.
CG-Taylor achieves the lowest latency of 0.0531 seconds under the same 6-NFC budget, but its FID deteriorates substantially to 73.45.
These results demonstrate that, despite incurring additional inference latency, ARCS maintains high generation quality even under aggressive acceleration.
Importantly, the latency trend observed on DiT-XL/2 should not be generalized to other models.
On FLUX.1-dev (Table 2), ARCS achieves lower latency and higher generation quality than SpeCa and CG-Taylor in both acceleration regimes. At approximately 7 NFC, ARCS achieves 8.6% and 38.1% lower latency, respectively, while attaining an ImageReward of 0.8450, compared with 0.6729 and -1.0849.
On HunyuanVideo, ARCS likewise achieves lower latency and higher generation quality than SpeCa in both regimes. At approximately 6 NFC, ARCS reduces latency by 14.0% (22.46 to 19.32 seconds) while improving VBench from 66.24 to 77.44.
Even when ARCS incurs additional latency, it substantially improves generation quality, while achieving simultaneous gains in inference speed and generation quality in several settings.
Threshold and Order Configuration
We acknowledge that ARCS requires threshold calibration to meet a target full-computation budget.
This involves selecting the base threshold (γ0) on a calibration set to match the target NFC, after which it remains fixed during evaluation. The threshold schedule parameter (rγ) is fixed at 1.15 across all models.
For forecasting order, only the model-specific maximum order is specified. The effective order increases automatically with available anchor history, requiring no separate configuration for each order.
Thus, although ARCS requires initial calibration, threshold and order configurations follow defined procedures without extensive manual tuning.