- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper addresses long-tailed deep clustering, i.e., partitioning unlabeled data with a long-tailed class distribution without access to labels, class frequencies, or the number of classes. The authors argue that dense head regions occupy redundant prototype capacity, leading to head-class over-segmentation and tail-class absorption. The proposed DRP framework builds on a frozen encoder with a zero-initialized residual adapter and combines the following components, several of which are adapted from existing techniques:
- a denoising-based support score that acts as a one-sided barrier on where new prototypes can be born;
- a Gibbs-tilted Dirichlet-process prior with a log-determinant repulsion term to discourage redundant prototypes;
- a finite MAP objective with a prototype activation criterion;
- under-coverage candidate generation with cardinality-preserving prototype swapping;
- prototype-balanced adapter training.
The method is evaluated on CIFAR-10-LT, CIFAR-20-LT, and STL-10-LT (imbalance ratios 5 and 10), Tiny ImageNet-LT, and ImageNet-LT, as well as on balanced ImageNet subsets with a CLIP encoder. The paper also reports cluster-number estimation, component ablations, and hyperparameter sensitivity.
Critical strengths
1. Acceptable novelty through a coherent combination of components. The paper organizes prototype birth, activation, repulsion, and reallocation under a single structural objective for long-tailed clustering, rather than only re-weighting samples. Although several components are transferred from existing work, their integration for this problem is reasonable and constitutes an acceptable level of novelty.
2. Considerable accuracy improvements. DRP outperforms the strongest baseline (MiniClustering) on most long-tailed benchmarks. For example, on CIFAR-10-LT its ACC is higher by 4.5 points at IR = 5 and by 2.8 points at IR = 10 (Tab. 1–2). Gains are also reported on Tiny ImageNet-LT and ImageNet-LT. This is the main empirical support for the method.
Critical weaknesses
1. Insufficient rigor in experimental reporting. I consider the writing and reporting issues a bigger problem than the method itself, because they directly affect how much the comparisons can be trusted.
- The baseline results in Tab. 1 and Tab. 2 appear to be taken from MiniClustering (ICLR 2026, https://proceedings.iclr.cc/paper_files/paper/2026/file/813ed01a11220fcdeed10e0d7da2de25-Paper-Conference.pdf). Most numbers are identical to Tab. 1 and Tab. 2 of that paper, but some individual entries do not match. For example, the STL-10 NMI of SeCu in Tab. 1 is 48.2 in MiniClustering but 46.0 in this paper.
- Line 408 states that a frozen CLIP ViT-B/16 image encoder is used "for all compared variants so that representation quality is controlled". However, the TAC results in Tab. 5 appear to be copied directly from the original TAC paper (https://arxiv.org/html/2310.11989v3), which uses a CLIP ViT-B/32 encoder. The comparison in Tab. 5 is therefore not controlled as claimed.
2. Heavy formula presentation and a bloated design.
- The method contains many components, which leads to a large number of redundant hyperparameters and makes the framework somewhat bloated.
- The paper also stacks many theoretical formulas, which hurts readability. Derivations that are already consensus in the field (e.g., standard variational or Gibbs-type results) could be abbreviated. For the necessary ones, I suggest naming common structures before referring to them and using underbrace annotations. For example, Eq. 11 appears to contain the negative free energy of EM for a vMF mixture model; annotating it as such would help readers see which theoretical sources the paper builds on.
- There is also a notational error at Line 296: "C_r = c̃_m ∈ I_r" equates a set (C_r) with an element (c̃_m), which cannot hold. I believe this is a typo.
Questions for authors
Clarifications:
- Are the baseline numbers in Tab. 1 and Tab. 2 reproduced by the authors or taken from MiniClustering? If they are taken from MiniClustering, are the mismatched entries (e.g., SeCu on STL-10, NMI: 48.2 vs. 46.0) typos introduced during transcription? Please clarify the source of each baseline result.
- Regarding the statement at Line 408: were the TAC results in Tab. 5 obtained with CLIP ViT-B/16, or taken from the original paper (ViT-B/32)? To keep the paper rigorous, please either re-run the baselines with ViT-B/16 or remove this statement.
- At Line 296, should the definition of C_r be {c̃_m : m ∈ I_r} (consistent with Appendix Eq. 40)? Please correct it.
Suggestions:
- Consider abbreviating derivations that are standard in the field, and annotating necessary formulas with underbraces and named structures (e.g., the vMF mixture EM free energy in Eq. 11) to improve readability.
If the authors resolve these issues, I will consider raising my score.
5 comments
[W2] Framework Complexity, Formula Readability, and Notation.
[W2-1] Component Contributions, Computational Cost, and Parameter Sensitivity.
Thank you for raising this concern. The components of DRP address different aspects of prototype allocation. Denoising support filters unsupported candidate prototypes, Gibbs repulsion suppresses redundant prototypes, under-coverage candidate generation identifies regions requiring additional capacity, and prototype-balanced adaptation balances the contributions of individual prototypes to representation learning. The ablation results in Table 7 of the paper support their contributions, with the removal of individual components reducing ACC on CIFAR-10-LT by 1.3–2.5 percentage points. Appendix C.4 further analyzes the computational cost. The denoiser is trained only once, and the repulsion term operates on a matrix, with its cubic cost depending on the number of active prototypes . With a fixed feature dimension, prototype budget, and number of optimization rounds, the overall computational cost scales approximately linearly with the number of samples. We further compared the runtimes of DRP and MiniClustering on CIFAR-10-LT (IR = 10), excluding BYOL pretraining for both methods. DRP takes approximately 28.33 minutes, compared with 26.8 minutes for MiniClustering, corresponding to an additional 1.53 minutes, or approximately 5.7%. Together with the ACC improvement from 64.6% to 67.4% reported in Table 2 of the paper, this comparison indicates that DRP achieves better performance with a modest increase in runtime. Although DRP introduces additional hyperparameters compared with MiniClustering, Figure 3 and Table 10 of the paper show that its performance is relatively insensitive to moderate variations in , , and . This suggests that the tuning effort remains manageable, allowing DRP to achieve substantial performance improvements with a modest increase in runtime.
[W2-2] Streamlined Derivations and Annotated Equations.
Thank you for these suggestions on improving readability. We have streamlined the standard derivations and clarified the structure of the main objective. We have explicitly labeled the fitting term in Eq. (11) as the EM free energy of a vMF mixture model, combined the fitting terms into a single expression, and used underbraces to distinguish the EM free energy, activation cost, support barrier, and prototype repulsion terms. We have also added explanatory text to improve readability. The revised Eq. (11) is shown below:
\mathcal F_{\mathrm{struct}} ={}& \underbrace{-\sum_i\sum_{m\in\mathcal I_r} q_{im}\left(\log\pi_m+\kappa z_i^\top\tilde c_m-\log q_{im}\right)}_{\mathcal E_{\mathrm{fit}}:\\ \text{vMF-mixture EM free energy}} \\\\ &+\underbrace{\lambda_a^{\mathrm{eff}}\lVert r\rVert_0}_{\text{activation cost}}+\underbrace{\lambda_s\sum_m r_m b_\psi(\tilde c_m)}_{\text{support barrier}} \\\\ &+\underbrace{\lambda_g\mathcal E_{\mathrm{rep}}(\mathcal C_r)}_{\text{prototype repulsion}}. \end{aligned}$$ We have abbreviated the standard variational steps in Sec. 3.2 and 3.3. Specifically, we moved the base-measure variational formulation in the original Eq. (3) to Appendix B.6 and replaced its main-text presentation with a concise description. We similarly refer readers to Appendix A.2 for the intermediate change-of-measure expression in the original Eq. (8) and its derivation. The main text now explicitly invokes the standard Gibbs variational principle and directly presents the resulting exponentially tilted base measure and Gibbs-tilted DP prior. We have also added underbrace annotations to the original Eq. (9) to identify their component structures. In the original Eq. (9), the annotations distinguish the CRP partition prior, denoising-support factor, and prototype-repulsion factor. We have revised the accompanying text to explain how these factors govern the partition, individual prototype locations, and their joint geometry, and how the repulsion factor contributes to the MAP objective. The annotated version of the original Eq. (9) is shown below: $$p_{\mathrm G}(\Pi_N,C\mid\psi)=\frac{1}{\mathcal Z_{G,N}}\underbrace{p_{\mathrm{CRP}}(\Pi_N\mid\alpha)}_{\text{CRP partition prior}}\\,\underbrace{\prod\nolimits_{k=1}^{K_+}h_\psi(c_k)}_{\text{denoising support}}\\,\underbrace{\det(\bar L_C)^{\lambda_g}}_{\text{prototype repulsion}}.$$ **We have refined the manuscript by streamlining the presentation of some standard derivations and adding explanatory annotations to the equations to improve readability.** ## [W2-3] Correction of the Active Prototype Set Notation. We thank the reviewer for pointing this out. We have corrected the definition of $C_r$ (now line 291 of the revised manuscript).[Q1] Clarification of Baseline Result Sources.
As clarified in our response to the first point of [W1-1] above, the baseline results in Tables 1 and 2 of the paper come from two sources. We reproduced the DGD results, while all other baseline results were taken from the MiniClustering paper. The discrepancy in the SeCu entry was due to a transcription error, and this entry has been corrected in the revised manuscript.
[Q2] Backbone Alignment for the Comparison with TAC.
As clarified in our response to [W1-2] above, the TAC results were taken from the original TAC paper and use CLIP ViT-B/32, whereas our initial DRP results used ViT-B/16. We additionally evaluated DRP with ViT-B/32 to provide a comparison using the same backbone architecture. Under this setting, DRP outperforms TAC across all reported metrics on all four balanced ImageNet datasets, as shown in the results provided in our response to [W1-2].
[Q3] Correction of the Definition of .
We thank the reviewer for pointing this out. We have corrected the definition of on line 296.
[Q4] Improved Readability of Derivations and Equations.
Thank you for these constructive suggestions. As detailed in our response to [W2-2] above, we have abbreviated the standard variational and Gibbs derivations in the main text and referred readers to the appendices for intermediate steps. We have also explicitly identified the vMF-mixture EM free-energy term and added underbraces to distinguish the fitting, activation, support, and prototype-repulsion components. The annotated equations and accompanying explanations are provided in that response.
We have streamlined the presentation of standard derivations (e.g., lines 223–226 of the revised manuscript) and refined the presentation of the equations (e.g., Eqs. 7 and 9 in the revised manuscript). We have also revised passages in the main text for clarity (e.g., lines 292–295 in the revised manuscript) and improved the exposition in the appendix (e.g., Sections A.1 and B.6 in the revised manuscript).
Thank you for your careful reading of our manuscript, detailed feedback, and constructive suggestions. Below, we respond to each of your comments and explain the corrections we have made and the additional supporting evidence we provide.
[W1] Baseline Reporting and Backbone Consistency.
[W1-1] Sources and Corrections of Baseline Results.
We agree with the reviewer that rigorous experimental reporting is essential for assessing the reliability of the comparisons. We followed the MiniClustering’s experimental settings and reproduced our experiments under the same protocol. For most competing methods, we report the results provided by the MiniClustering to ensure a consistent comparison. We acknowledge the two incorrect entries in our tables and sincerely apologize for these mistakes. We have corrected them in the revised version and carefully rechecked all reported results. To facilitate verification and reproducibility, we will release our code and experimental configurations.
We have corrected the results in the revised version paper (Table 1) and carefully rechecked all reported results.
[W1-2] Backbone Settings for the Comparison with TAC.
We thank the reviewer for this careful observation. The TAC results reported in the original submission use a CLIP ViT-B/32 encoder, whereas our initial DRP experiments used a frozen CLIP ViT-B/16 encoder. We have revised the statement at Line 402, additionally evaluated DRP with ViT-B/32, and included these results in Table 5 of the revised manuscript. As shown in the Table below, DRP outperforms TAC across all reported metrics on all four ImageNet datasets when using the same backbone architecture, demonstrating DRP’s effectiveness with both backbone configurations.
Table 12. Balanced ImageNet clustering (%).
We have added DRP results obtained with ViT-B/32 to Table 5 of the revised manuscript and refined the description of DRP.