- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Decoupled Generative Refinement (DGR), a two-stage training and fine-tuning framework for long-tailed diffusion models. Stage 1 trains a model using Oriented Calibration (OC-LT) to improve tail-class generation through head-to-tail knowledge transfer and establish a calibrated initialization. Stage 2 fine-tunes this model using Static Pool Resampling (SPR), which reuses fixed, class-balanced seed–label pairs for upper-level evaluation and combines zeroth-order objective-gradient estimates with lower-level denoising gradients. The intended goal is to improve generation quality while preserving the tail-class semantics established in Stage 1. Validation includes FID/IS comparisons on CIFAR-10-LT, CIFAR-100-LT, and TinyImageNet200-LT, alongside class-wise diagnostics and unseen-seed evaluations.
Critical strengths
1.The experiment shows improvements over the same Stage-1 initialization across different datasets prove the proposed refinement is useful.
2.Evaluations on unseen seeds, class-wise and oracle-based diagnostics, also go beyond aggregate FID and attempt to assess whether improvements generalize beyond the fixed evaluation pool.
Critical weaknesses
1.Table 1 does not show consistent state-of-the-art performance: CORAL (2025) outperforms DGR on four of the six metrics. The more recent relevant CCUA [1] is absent from the comparisons.
2.The evaluation is also limited to CIFAR and TinyImageNet with a U-Net backbone. However, CCUA includes ImageNet-LT at 256×256 resolution with DiT. Evaluation at this scale and with a Transformer-based backbone would be important to show whether DGR’s benefits are limit in low-resolution U-Net settings.
3.The interpretation of Figure 5 overstates the tail-specific benefit: the accompanying text on page 9 claims that oracle accuracy improves most clearly for the Tail group, but the values printed on the bars show gains of 1.2 percentage points for Head (0.927→0.939), 1.6 for Medium (0.883→0.899), and only 0.9 for Tail (0.872→0.881).
Reference
[1] Chen, F., Villa, A., Liang, G., Fuxin, L., Lu, X., Tang, M. (2026). Contrastive Conditional–Unconditional Alignment for Long-Tailed Diffusion Model. In: Favaro, P., Kukelova, Z., Maki, A., Rohrbach, A., Schindler, K., Tombari, F. (eds) Computer Vision – ECCV 2026. ECCV 2026. Lecture Notes in Computer Science, vol 17022. Springer, Cham. https://doi.org/10.1007/978-3-032-37520-9_23
Questions for authors
see weaknesses
2 comments
Thank the authors't response. My concern about Figure 5 has been resolved. However, my concerns about the experiment remain:
-
Adding CCUA’s published CIFAR results broadens the baseline comparison, but does not resolve the concern that DGR does not demonstrate consistent state-of-the-art performance.
-
Concern about DGR's benefit is limited to a U-Net backbone remains. The authors provide no experiments on Transformer-based diffusion models and acknowledge that DGR’s benefits in this setting remain to be tested.
Therefore I will maintain my score.
Response to Reviewer 8uPk
Thank you for recognizing the value of comparing refinements from the same calibrated model and for checking the values in Fig. 5.
1. Extreme imbalance and comparisons with CORAL and CCUA
On CIFAR-10-LT at IF=1000, both refinement variants start from the same T2H checkpoint, trained at IF=100 and then adapted to IF=1000 (FID 7.88). Table 1 reports 10.05 for online refinement. The evolved SPR image pool scores 6.86, 12.9% below the Stage-1 value. That percentage describes the scored pool. Figure 4(b) separately tests the final generators on uniformly sampled labels and the same unseen seeds. Most classes favor SPR under extreme imbalance, with exceptions.
We agree that CORAL leads in four of the six Table 1 entries. At IF=1000 our evolved pool records 6.86 FID and 9.72 IS, compared with CORAL's published 11.03 and 9.13. We will identify the source of each score, the warm start and the evolved-pool evaluation in the table. This preserves the evidence for refinement under extreme imbalance while making the differences in evaluation protocol visible.
We will also add CCUA's published CIFAR results. Its Table 7 reports DDIM-100 FIDs of 5.56 on CIFAR-10-LT and 6.24 on CIFAR-100-LT. These U-Net results are directly relevant related work. We will specify each paper's training and scoring protocol alongside the scores so readers can distinguish cross-paper benchmarks from our shared-checkpoint comparison. Chen et al., CCUA, Table 7
2. Does the benefit transfer to a diffusion Transformer?
CCUA demonstrates its method on ImageNet-LT at 256 × 256 with SiT. Our evidence for DGR comes from U-Nets on CIFAR-LT and TinyImageNet200-LT. A direct comparison with CCUA's ImageNet-LT numbers changes the architecture, dataset, resolution and training history together. The experiment that would answer your question is to take one calibrated Transformer checkpoint and compare SPR with online refinement on ImageNet-LT using the same budget and final sampling protocol. We will state that DGR's benefit in this setting remains to be tested. Chen et al., CCUA, Table 6
3. Corrected interpretation of Fig. 5
You are right about the ordering. We will replace the sentence on page 9 with the following text. “Compared with unconstrained refinement, SPR increases oracle accuracy in all three groups. Medium has the largest gain, from 88.3% to 89.9% (+1.6 percentage points), followed by Head, from 92.7% to 93.9% (+1.2 points). Tail improves from 87.2% to 88.1% (+0.9 points).” The tail result matters because these classes have the fewest training examples. The figure supports improved tail semantic fidelity in this comparison, with the largest measured improvement in Medium.