- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how to use a limited synthetic-data budget to improve image classification when the complete real training set is retained. The authors propose Gap-Targeted Synthesis (GTS), which identifies two types of coverage gaps in frozen real-data features: mode gaps, representing relatively underrepresented observed modes within a class, and variation gaps, representing undercovered intervals along variation directions shared across classes. These gaps determine generation quotas across classes and targets, and a pretrained diffusion model is guided toward the corresponding feature targets during sampling. The resulting synthetic dataset is then combined with the full real training set for classifier training. The authors evaluate GTS on ImageWoof2 across three classifier architectures and multiple synthetic-data budgets, comparing it with controlled baselines and prior diffusion-based dataset-distillation methods. Additional experiments cover ImageNette and ImageIDC, evaluation under distribution shifts, paired-noise target-attainment measurements, ablations of the two gap components, guidance-strength sensitivity, controlled mode deletion, and generation cost.
However, the proposed gap definitions lack sufficient justification. The uniform mode reference may incorrectly treat naturally rare modes as coverage gaps, while the cross-class variation reference may mistake legitimate class-specific differences for insufficient coverage. The experiments are also limited to ten-class datasets, leaving the method's applicability to larger-scale classification tasks unclear. In addition, the ablations do not adequately examine how key design choices affect gap identification.
Overall, I recommend Clear Rejection (1/4).
Critical strengths
The paper addresses an interesting and practically important question: how to allocate a limited synthetic-data budget to improve classification when the full real training set is already available. Focusing on what synthetic samples can add beyond the existing data provides a useful perspective on making synthetic augmentation more effective.
Critical weaknesses
-
The distributional rationale for targeted augmentation remains unclear. GTS selectively adds synthetic samples to regions identified as undercovered, thereby changing the effective training distribution. However, it is unclear whether these regions are underrepresented relative to the downstream test distribution or merely relative to the method’s chosen structural references. If the real training and test data follow the same distribution, naturally unequal mode frequencies or class-specific variation distributions do not necessarily indicate deficiencies that should be corrected. If a distribution shift is assumed, the paper does not establish why the proposed references approximate the coverage needed under that shift. A more explicit distributional formulation and controlled analysis of this mechanism would strengthen the motivation for targeted synthesis.
-
The uniform reference for mode gaps is insufficiently justified. Eq. (4) assumes equal mass across observed clusters, although naturally occurring modes need not be equally frequent. Consequently, a small cluster may represent a genuinely rare variation rather than missing coverage. The diagnosis also depends on clustering granularity and cannot independently identify completely unobserved modes.
-
Variation gaps rely on an insufficiently validated cross-class assumption. Class centering does not ensure that shared PCA axes capture semantically equivalent variations across classes. Differences from the other-class reference may therefore reflect legitimate class-specific structure rather than undercoverage. More direct validation of the detected target-class gaps is needed.
-
The evaluation is limited to small-scale datasets. GTS is evaluated on three ten-class ImageNet subsets, leaving its scalability to larger and more heterogeneous class collections unverified. Several directly related methods provide such evaluations: MGD³ [1] reports ImageNet-100 and ImageNet-1K experiments in Sec. 5.1; CaO² [2] reports both in Table 2; and IMS³ [3] includes them in Appendix Secs. 8.1 and 8.11. This matters particularly for GTS because its variation-gap diagnostic relies on shared cross-class structure, whose reliability may change substantially as class diversity increases. Evaluation on ImageNet-100 or ImageNet-1K under the proposed additive protocol would strengthen the evidence for general applicability.
-
Sensitivity of the gap diagnosis is insufficiently examined.. The reported sensitivity analysis focuses on guidance strengths, while the cluster count, PCA dimensionality, gap thresholds, and diagnostic calibration also determine the selected targets and quotas.
-
The presentation is difficult to follow. Key methodological details are scattered between the main text and appendix, and some notation is ambiguous. Clearer explanations and more consistent notation would improve readability.
[1] Chan-Santiago, J. A., Tirupattur, P., Nayak, G. K., Liu, G., & Shah, M. (2025). MGD : Mode-Guided Dataset Distillation using Diffusion Models. arXiv preprint arXiv:2505.18963.
[2] Wang, H., Zhao, Z., Wu, J., Shang, Y., Liu, G., & Yan, Y. (2025, October). Cao 2: Rectifying inconsistencies in diffusion-based dataset distillation. In 2025 IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 4722-4731). IEEE.
[3] Wang, C., Chen, Y., Yang, Z., Zhou, J. T., & Zhang, C. (2026). IMS3: Breaking Distributional Aggregation in Diffusion-Based Dataset Distillation. arXiv preprint arXiv:2603.13960.
Questions for authors
-
Could the authors explain the distributional rationale for GTS more explicitly? Does the method assume a shift between the real training and test distributions, and why should the uniform mode reference and cross-class variation reference identify deficiencies relevant to the test distribution rather than natural distributional differences?
-
Could the authors provide experiments on ImageNet-100 or ImageNet-1K under the same additive protocol to assess scalability and the reliability of the shared-variation reference with more heterogeneous classes?
-
Could the authors provide additional ablations or sensitivity analyses for the cluster count, number of retained PCA axes, gap-detection thresholds, and relative weighting of the two diagnostics, and examine how these choices affect the detected gaps and downstream accuracy?