- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DPRG (Distinction-Preserving Representation and Guidance), a multimodal dataset distillation framework that addresses semantic degeneracy in prototype-based diffusion distillation. The method combines joint image-text clustering, over-clustering with diversity-based prototype selection, and hard-negative Triple CFG to improve semantic distinctness during synthetic data generation. Experiments on four datasets demonstrate consistent improvements in cross-modal retrieval across different distillation budgets and downstream architectures.
Critical strengths
-
Relevant problem formulation. The paper identifies semantic degeneracy as a potential limitation of prototype-based multimodal dataset distillation, where semantically distinct image-text pairs may be merged during clustering or become indistinguishable during generation. This is a meaningful concern for downstream contrastive learning.
-
Coherent methodological design. DPRG addresses semantic distinctness during both prototype discovery and image generation. Joint pair clustering, over-clustering with coverage selection, and hard-negative Triple CFG form a reasonably well-motivated framework.
-
Consistent empirical improvements. The proposed method improves mean recall across all 20 dataset-budget-backbone configurations. For example, on Flickr30K with 100 synthetic pairs and NF-ResNet50, DPRG improves mean recall from PDS 24.7% to 30.2%.
-
Comprehensive component ablations. The experiments evaluate different combinations of the three proposed components and demonstrate their complementary behavior. In particular, over-clustering becomes beneficial when combined with pair coupling, providing useful evidence about the interaction between representation construction and prototype selection.
-
Computational efficiency. DPRG achieves improved retrieval performance with a relatively small increase in dataset construction cost compared with PDS. This makes the framework practically attractive for settings where repeated multimodal model training is expensive.
-
Evidence of transferability. The experiments consider NF-ResNet50 and ViT downstream architectures, alongside an alternative SigLIP and FLUX.1-dev configuration. These results provide evidence that the method is not entirely dependent on one specific image encoder and diffusion generator combination.
-
Additional analysis of semantic distinctness. The retrieval-margin experiments report improvements of approximately 1.6 to 2.5 times over PDS, while the qualitative results illustrate increased diversity among generated image-text pairs. These findings provide supporting evidence for the proposed motivation, although they do not fully validate local semantic coherence.
Critical weaknesses
-
Insufficient coverage of closely related multimodal dataset distillation methods. The related work does not adequately position DPRG relative to recent advances in joint multimodal representation construction and diversity preservation. In particular, MDM (CVPR 2026) already employs joint image-text embedding clustering for synthetic pair initialization, while EDGE (NeurIPS 2025) explicitly addresses insufficient diversity among generated multimodal samples through a diversity loss. MDM is not properly cited or discussed, and although EDGE appears in the experimental comparisons, its conceptual relationship to DPRG is not sufficiently examined. These omissions weaken the novelty assessment and the positioning of the proposed contributions.
-
Insufficient differentiation from existing joint clustering and diversity-preserving techniques. Pair coupling and over-clustering are presented as important mechanisms for preserving semantic distinctions, but their relationship to the joint embedding clustering used in MDM is not clearly established. Similarly, Triple CFG aims to prevent semantically indistinguishable generated samples, which is closely related to the diversity preservation problem already investigated by EDGE. Although the optimization mechanisms differ, the paper should explicitly clarify what conceptual and methodological advances DPRG offers beyond these existing approaches.
-
Unclear generality of semantic degeneracy across MDD paradigms. The paper primarily studies semantic degeneracy in prototype-based diffusion distillation, without establishing whether similar phenomena occur in distribution-matching, kernel-based, or trajectory-matching methods. This is particularly relevant because existing methods such as MDM and EDGE already incorporate mechanisms related to cross-modal alignment and sample diversity. The paper should clarify whether semantic degeneracy is a general limitation of multimodal dataset distillation or a specific failure mode of the prototype-based pipeline.
-
Limited direct evidence for local semantic coherence. The evaluation primarily relies on retrieval performance, retrieval margins, and qualitative visualizations. These measures do not directly establish whether local semantic neighborhoods or fine-grained cross-modal relationships are preserved. Stronger analyses of neighborhood consistency, semantic cluster preservation, and local alignment would be necessary to substantiate the central claims.
-
Restricted downstream evaluation. The main experiments assess cross-modal retrieval with frozen encoders and a trained projection head. Although this follows established evaluation protocols, it is insufficient to demonstrate that the distilled datasets retain broader semantic information or support general multimodal representation learning.
-
Incomplete characterization of backbone dependence. The experiments with SigLIP and FLUX.1-dev demonstrate transfer beyond the default CLIP and unCLIP configuration, but both settings still rely on pretrained aligned image-text representations. It remains unclear whether DPRG's improvements depend primarily on strong pretrained joint embedding spaces or whether the proposed method remains effective with weaker representations.
-
Potential conflict between diversity and distribution fidelity. Farthest-first prototype selection prioritizes semantic separation, potentially favoring sparse or atypical regions of the embedding space. The paper does not sufficiently examine whether this introduces distributional bias or sacrifices common semantic modes.
Questions for authors
-
Relationship to previous MDD works. (i) MDM (CVPR 2026) already uses clustering in a joint image-text embedding space for synthetic data initialization. How does DPRG's pair coupling differ conceptually and empirically from this approach? Could the authors provide a controlled comparison or clarify the additional benefits of their representation construction strategy? (ii) EDGE (NeurIPS 2025) explicitly addresses insufficient diversity among generated multimodal samples through a diversity loss. How does DPRG's proposed semantic degeneracy differ from the diversity problem identified in EDGE? What advantages does retrieval-based Triple CFG provide over existing diversity-preserving objectives, apart from downstream retrieval performance?
-
Literature completeness and novelty. Could the authors expand the related work to discuss MDM and the diversity-preserving components of EDGE in greater detail? Given the overlap in motivation and certain design principles, a clearer account of the distinctions from these methods is important for evaluating novelty.
-
Generality of semantic degeneracy. Does semantic degeneracy also arise in distribution-matching, kernel-based, and trajectory-matching multimodal dataset distillation approaches? If it is primarily a limitation of prototype-based diffusion methods, what properties of this pipeline make it particularly susceptible to semantic collapse?
-
Direct evaluation of semantic coherence. Can the authors provide quantitative evaluations of local neighborhood preservation, semantic cluster purity, or fine-grained cross-modal consistency? These would help distinguish improved semantic structure preservation from increased separation between synthetic samples.
-
Evaluation beyond retrieval. Can the authors demonstrate improvements on additional multimodal tasks, such as image-text matching, compositional understanding, or attribute-level discrimination? Such evaluations would provide stronger support for the claim that the method preserves meaningful semantic distinctions.
-
Backbone dependence. How sensitive is DPRG to the quality and alignment of the pretrained image-text representation? Experiments using encoders with different capacities or alignment quality would help clarify the extent to which the reported improvements depend on CLIP-like pretrained representations.