- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- The paper proposes RC-Cat, a one-step categorical label diffusion framework for noisy-label classification. It avoids expensive iterative reverse-chain sampling, achieving inference throughput comparable to a simple MLP baseline while retaining the benefits of label diffusion training. A key conceptual insight is validated: iterative reverse-chain inference is not required to obtain the denoising benefit. The performance gain mainly originates from training on corrupted label states with timestep conditioning, rather than multi-step sampling at test time.
- The paper designs a carefully controlled matched baseline (parameter-matched MLP). It isolates the performance gain brought by the corruption-conditioning training paradigm, removing confounding factors from representation and retrieval.
- Extensive comparisons are conducted against both classic noisy-label learning methods (Co-teaching+, GCE, PLC, etc.) and state-of-the-art label diffusion approaches (DLD, LRA). The method achieves strong performance especially under severe synthetic label noise (PMD-70).
Critical strengths
- The paper proposes and validates a key insight: denoising gains can be obtained without iterative reverse-chain inference. The performance improvement mainly stems from training on corrupted label states with timestep conditioning, rather than multi-step sampling at test time.
- The authors carefully design a controlled baseline (parameter-matched MLP) for comparative experiments.
- The mathematical formulation in the method section is clear and easy to follow; Figures 1 and 2 are also intuitive.
- The authors have provided partial code and commit to releasing the full code as open source.
Critical weaknesses
- The abstract contains multiple intermediate staged accuracy values (60.29%→64.78%→71.29%). While these figures are important for the experimental section, they constitute redundant details in the abstract. They consume the limited word budget of the abstract and distract readers from the high-level scientific contributions.
- Nearly half of the current abstract describes experimental observations. For a mechanism-focused paper, the abstract should prioritize highlighting: open research problems remaining in label diffusion; the high-level design of RC-Cat; the core insight that iterative reverse inference is not mandatory; the overall advantages and applicability boundaries of the one-step scheme. Specific numbers from stepwise ablation studies are recommended to be moved to the experimental section in the main text.
- Table 2 only enumerates published values from existing literature rather than results reproduced under a unified experimental setup. Traditional label-noise-robust methods such as Co-Teaching, GCE and PLC directly adopt results reported in their original papers. Differences in pre-trained features, data augmentation, training epochs and optimizers mean these values can only serve as references and cannot be used for rigorous comparisons.
- Ablation on inference hyper-parameters: full sweep over K (the number of Monte Carlo samples). Currently only K=4 is validated to be effective, without sensitivity analysis for hyper-parameter K.
- examine how accuracy saturates with increasing K;
- observe the magnitude of variance reduction;
- analyze scenarios where K=1 is sufficient and scenarios requiring a large K.
- The main text includes the passage: On Clothing1M, the nearly identical performance of RC-Cat and the matched classifier may additionally reflect the different large-scale regime: with roughly one million training examples and only 14 classes, strong frozen representations and candidate supervision may already make the classification problem sufficiently constrained that corruption-aware training provides little additional benefit. We therefore view the benefit of RC-Cat as noise- and data-regime dependent rather than uniform across noisy-label settings. Although Appendix A2 contains several numerical results, the relationships among these data remain unclear. please specify the exact performance metrics. Explain why no performance gain is observed and verify this conjecture. Further validate the performance of the proposed method on large-scale real-world noisy-label datasets.
Totally, experiments are enough for supporting claims in the paper
Questions for authors
to see above weaknesses.