- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents CINDI, a pixel-space generative model that improves inference efficiency through coarse-to-fine sampling. A shared Transformer and implicit neural renderer predict clean images at both the active and next resolutions. The next-scale bridge loss supervises the higher-resolution predictions used at scale transitions. Experiments demonstrate comparable FID to strong JiT baselines with substantially higher throughput.
Critical strengths
-
Clear presentation and coherent design. The paper is well written and easy to follow. The motivation, two-resolution prediction interface, training objective, and sampling procedure are clearly connected. Each component serves the concrete goal of reducing expensive full-resolution computation.
-
Useful supervision for scale transitions. Jointly supervising the current and next resolutions provides a direct training signal for the predictions used during sampling. The ImageNet-64 ablations support its effectiveness. For example, adding the next-scale loss improves FID from 2.75 to 2.19 in the 32→64 setting. I consider its integration into the shared implicit denoiser a meaningful aspect of the method.
-
Encouraging efficiency gains with minimal parameter overhead. The ImageNet-256 models introduce less than 0.5% additional parameters while achieving approximately 2.0–2.2× higher BF16 throughput at comparable FID. The matched JiT comparisons provide useful controlled evidence. Figure 4 also shows an appealing quality–throughput trade-off among the evaluated operating points, with CINDI-L achieving the highest measured throughput.
Critical weaknesses
-
The relationship to prior cross-resolution objectives needs clarification. Next-scale prediction has precedents in visual generation and language modeling. More directly, Scale Space Diffusion already supervises clean-image prediction at the next resolution from a potentially lower-resolution noisy input using weighted MSE (§4.2, Eq.7). CINDI’s joint current/next-resolution supervision and implicit rendering interface appear to provide a more specific distinction, but this relationship should be discussed explicitly to establish the methodological contribution.
-
The central loss ablation is limited to ImageNet 64. Since the practical high-resolution results are an important part of the paper, removing the next-scale loss in the 128→256 setting would provide stronger evidence that this component remains effective at the main evaluation resolution.
Questions for authors
-Could the authors clarify the distinction between the proposed next-scale bridge loss and prior cross-resolution prediction objectives, particularly Scale Space Diffusion? Which benefits arise specifically from jointly supervising both resolutions through the shared implicit renderer?
- Could the authors report an ImageNet-256 ablation without the next-scale loss, keeping the remaining training and sampling settings fixed?
3 comments
after rebuttal
Thank you for the clarifications and the additional ImageNet-256 ablation. The comparison with SSD helps clarify the methodological distinction, and the new ablation supports the benefit of next-scale supervision at the main evaluation resolution. These responses address my main questions. Please incorporate the additional ablation and the clarified comparison into the revised manuscript.
Thank you so much for your thoughtful feedback. We are glad that our clarifications and the additional ablation have addressed your main questions. We have added both the additional ablation and the clarified comparison with SSD into the latest revised manuscript. We sincerely appreciate your time and constructive suggestions.
We sincerely thank the reviewer for their time, thoughtful feedback, and questions. We respond to each point below.
Q1. Could the authors clarify the distinction between the proposed next-scale bridge loss and prior cross-resolution prediction objectives, particularly Scale Space Diffusion? Which benefits arise specifically from jointly supervising both resolutions through the shared implicit renderer?
Yes, we'd like to thank the reviewer for bringing Scale Space Diffusion (SSD) [1] to our attention. We were previously unaware of this work and will cite it in the revised manuscript.
Below, we will first briefly discuss how SSD differs from CINDI, and then address the reviewer’s questions accordingly.
What is supervised and how CINDI and SSD supervise its next-resolution, respectively:
Benefit from jointly supervising both resolutions through the shared implicit renderer:
In addition to the benefit we mentioned earlier (CINDI requires no special correlated noise at transition), another practical benefit of joint supervision is flexibility in timestep allocation. Thanks to joint supervision, every step of CINDI's non-final scale supports a scale transition, so user can flexibly allocate coarse/fine timestep using a single trained checkpoint. Evaluation can accommodate any combination of step allocations, including an early jump midway through the coarse timesteps. On the other hand, SSD trains its resolution-increasing pathway only at the transition timesteps specified by its training schedule. Although its sampler can skip denoising steps, the resolution transitions remain tied to that schedule. Therefore, placing transitions elsewhere means training a completely new model, as shown in its schedule ablation (Fig. 5), which trains one model per schedule.
Q2:Could the authors report an ImageNet-256 ablation without the next-scale loss, keeping the remaining training and sampling settings fixed?
Yes, Please see table below for the requested ablation:
At 200 training epochs on ImageNet-256, with all other settings fixed, adding the next-scale loss reduces CINDI L/16’s FID from 2.93 to 2.77. This result is consistent with our ImageNet-64 finding and supports the contribution of next-scale supervision to generation quality.
Finally, we sincerely thank the reviewer for taking the time to read our rebuttal. We hope the additional information and experimental results address your concerns, and we would greatly appreciate your consideration of a higher score in light of this new evidence. Thank you!
References
[1] Soumik Mukhopadhyay, Prateksha Udhayanan, and Abhinav Shrivastava. Scale Space Diffusion. CVPR, 2026, pp. 35851–35860.