acceptodds
Under review as a conference paper at ICLR 2027

Diffusion Soft Labeling for Model Calibration

Abstract

Overconfidence is a pervasive problem for modern classification models based on neural networks. One key source is the hard sample labels used in cross-entropy loss, which are one-hot probability vectors that encourage high confidence. Existing model calibration approaches have tried introducing softer supervision signals, which however, rely on heuristic rules and may not accurately reflect the label uncertainty. In this work, we propose Diffusion Soft Labeling (DiffSL), which assigns soft labels according to a data-driven principle. Specifically, DiffSL constructs initial soft labels from diffusion classifier predictions with top-k class clipping, then corrects wrong labels using ground-truth labels. Extensive experiments show that DiffSL significantly improves calibration performance over existing methods while maintaining competitive classification accuracy.

Primary area:
probabilistic methods (Bayesian methods, variational inference, sampling, UQ, etc.)
Keywords:
Model Calibration, Diffusion Models, Soft Labels

Reviews

Among:
Shape:
1234this paper, Top 49%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.33 over 3 reviews, above 51% of the others.
Reviewer_yupuOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes Diffusion Soft Labeling (DiffSL), a training-time calibration method that uses a class-conditional diffusion classifier to produce soft labels for original training samples and for inter-class augmented samples. Two techniques are introduced: top-kk class clipping, which restricts diffusion-classifier evaluation to a candidate set suggested by a pretrained reference classifier, and label correction, which zeroes out incorrect-class probabilities and re-normalizes among the correct class set. The classifier is trained with KL divergence to these soft labels. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet with ResNet-50/101 report the lowest ECE/AECE among the compared baselines while maintaining competitive accuracy.

Critical strengths
  1. The core idea is clean and the empirical results are consistent. The story is intuitive: if soft labels approximate p(y∣x)p(y|x), they should calibrate better than one-hot labels, and a class-conditional diffusion classifier is a natural source. The ECE/AECE gains are consistent across six dataset–architecture settings, and the soft-label-source ablation (pretrained classifier vs. DDPM vs. EDM) is a useful sanity check.

  2. The method is reasonably well engineered. Top-kk clipping makes diffusion-classifier labeling tractable at C=100/200C=100/200, and label correction addresses an obvious failure mode. The comparison with the diffusion classifier itself and with CSM re-annotation helps position the contribution.

Critical weaknesses
  1. The computational cost and scalability are not analyzed clearly enough. DiffSL requires a class-conditional diffusion model and, for each training sample, Nϵ×kN_\epsilon \times k diffusion-classifier evaluations. The paper reports NFE reduction relative to full-class DC, but not absolute wall-clock time, total GPU hours, or a comparison with the training cost of the baselines. This is the main reason I am not yet convinced the method is practically attractive: temperature scaling, label smoothing, and focal loss are far cheaper. I am not asking for ImageNet-1K experiments—I understand that is out of scope—but a serious cost–benefit analysis at the reported scale would materially change my view.

  2. The quality of the diffusion-classifier soft labels is assumed rather than validated, and the augmentation component is not cleanly isolated. Section 4.1 gives the standard argument that soft labels help if they approximate p(y∣x)p(y|x), but there is no analysis of whether the diffusion classifier actually provides reasonable posterior estimates. Figure 3 shows a temperature-scaled DC, not raw DC calibration. If DC has systematic biases, DiffSL may simply transfer them. In addition, Table 5 shows that inter-class augmentation is not uniformly beneficial (CIFAR-10 prefers Naug=0N_{\text{aug}}=0, CIFAR-100 prefers Naug=2N_{\text{aug}}=2), so the contribution of the core soft-labeling component versus the augmentation component is not cleanly separated.

Questions for authors
  1. Can you report GPU hours for (a) diffusion-model training, (b) soft-label generation, and (c) final classifier training, and compare these with the baselines? A table with wall-clock time per 1k training samples for DiffSL vs. label smoothing / focal loss / temperature scaling would be helpful. A short discussion of how cost scales with CC and kk would also be useful for readers considering larger datasets.

  2. Can you report raw (un-temperature-scaled) DC calibration, and compare DC soft labels with a simple proxy posterior (e.g., a small ensemble or a held-out estimate)? A sensitivity check to DC checkpoint quality (e.g., two checkpoints) would also be informative. Even a qualitative analysis—e.g., how often the DC top-1 disagrees with the true label, and whether label correction is doing most of the work—would help.

  3. Can you report soft labeling only (Naug=0N_{\text{aug}}=0) across all six settings in the main table, not just in the ablation? This would let readers see whether the calibration gain comes primarily from soft labeling or from augmentation.

  4. Can you clarify the validation-set size and tuning protocol for temperature scaling on the baselines, and confirm that the comparison is fair? A compute-matched CSM baseline using the same diffusion model would strengthen the comparison.

  5. The top-kk clipping definition around Page 6 appears incomplete or truncated. Can you provide the full construction of qclip\mathbf{q}^{\text{clip}} and clarify how label correction interacts with the candidate set S\mathcal{S}, especially for augmented samples where S={a,b}\mathcal{S}=\{a,b\} but the DC top-1 may be a third class? This is a presentation issue, but it currently makes the method harder to reproduce.

  6. A recent AAAI 2025 paper, “Training Deep Neural Networks with Virtual Smoothing Classes” (Zhou et al.), proposes a rule-based soft label that addresses label smoothing’s side effects by introducing virtual classes. Could you discuss the conceptual relationship between DiffSL’s label correction and the virtual smoothing mechanism? When might data-driven soft labels from a generative model be preferable to well-designed rule-based soft labels?

  7. Can you report reliability diagrams for DiffSL itself (not only for the temperature-scaled DC), and add Brier score / NLL? These are cheap to compute and would make the calibration claim more complete.

4 comments
AuthorsOpenReview ↗

Response to Reviewer yupu (1/4)

We thank the reviewer for the detailed feedback and for recognizing our clear core idea and consistent empirical results.

W1/Q1

We reuse RDC's pretrained EDM (Chen et al., 2024) without additional training. We can release datasets with soft labels so users can train their own models directly on them, with only a minor change to the loss function and no other changes to the training code. Even in a cold-start setting where all models must be trained from scratch, labeling is required only once per dataset and labeling configuration. These labels can be reused throughout repeated model training, hyperparameter tuning, and evaluation without relabeling.

The table below estimates augmented data generation(w/ labeling) costs in GPU-hours on NVIDIA RTX 4090. Labeling uses selected temperatures and top-15 on CIFAR-100/Tiny-ImageNet. A dash means no augmentation.

Cost componentCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
Original data labeling14.1814.1826.1025.8967.8967.66
Full pool generation (w/ labeling)——23.0723.19266.61—

Per 1,000 original images, CIFAR-10 DC scoring takes 0.2837 GPU-hours. Top-15 labeling takes 0.5218 / 0.5177 GPU-hours on CIFAR-100 and 0.6786 / 0.6763 on Tiny-ImageNet for ResNet-50 / ResNet-101.

The table below reports estimated GPU-hours per training run. Parentheses indicate the number of augmented images used per original image.

MethodCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
Label smoothing3.405.843.475.936.6110.14
Focal loss3.375.923.545.986.6210.12
CE + TS3.365.863.456.006.6010.14
DiffSL3.285.798.08 (NaugN_{\mathrm{aug}}=2)12.57 (NaugN_{\mathrm{aug}}=2)12.24 (NaugN_{\mathrm{aug}}=1)10.25

Without generated augmentation, training costs are comparable to the baselines. Augmentation increases training cost but reduces CIFAR-100/ResNet-50 ECE from 5.16% to 1.08% in Table 4. Classifier training and inference require no diffusion computation.

DC scoring scales as O(NlabelNϵk)O(N_{\mathrm{label}} N_{\epsilon} k) for NlabelN_{\mathrm{label}} images, NϵN_{\epsilon} noise samples per class score, and kk candidate classes per image. Relative to all CC classes, k=15k=15 reduces class evaluations by 85% on CIFAR-100 and 92.5% on Tiny-ImageNet. With a fixed number of generated images per class pair, the pool scales as O(C2)O(C^2). For large CC, one can use inter-class distances to form pairs only between nearby classes, which would reduce the pool size to O(C)O(C) by keeping a fixed number of neighbors per class.

AuthorsOpenReview ↗

Response to Reviewer yupu (2/4)

W2/Q2

(1) Raw DC calibration. DC approximates class-conditional log-likelihoods using the diffusion loss and constructs class probabilities from these estimates. Though the diffusion loss is derived from an evidence lower bound (ELBO), specific training configuration (e.g., viewing wtw_t as constant 1 during training) may make this loss no longer an accurate estimation of ELBO. Accordingly, as described in Section 4.3, DiffSL incorporates temperature scaling into soft-label construction, selecting the temperature that minimizes calibration error to improve confidence calibration while preserving class rankings. We additionally report DC results before temperature scaling to show the calibration improvement achieved by this step.

DatasetRaw DC ECE (%)Temperature-scaled DC ECE (%)
CIFAR-100.62070.0847
CIFAR-1003.04640.4623
Tiny-ImageNet16.98010.8259

We compare DC and a pretrained ResNet-56 discriminative classifier after temperature scaling. Both use the same CIFAR test splits, fitting temperature by NLL on 2,000 images and evaluating on the remaining 8,000.

DatasetModelACC (%) ↑ECE (%) ↓NLL ↓Brier ↓
CIFAR-10ResNet-5694.510.97350.18710.0842
CIFAR-10DC93.910.59450.17760.0884
CIFAR-100ResNet-5672.462.82221.05360.3846
CIFAR-100DC80.542.69400.76440.2794

DC achieves lower ECE and NLL on both test sets. Its Brier score is lower on CIFAR-100 but slightly higher than ResNet-56 on CIFAR-10. Low training ECEs and these test comparisons support using DC predictions to construct high-quality soft labels.

(2) Soft-label sources and diffusion model choice. In Table 2, both EDM and DDPM soft labels improve calibration over pretrained-classifier labels under identical CIFAR-10/ResNet-50 settings using only original data. EDM maintains comparable accuracy. These results support the calibration benefit of diffusion soft labeling across model choices.

(3) Prediction disagreement and label correction. For original training samples, we apply correction only when the DC top-1 prediction within the candidate classes disagrees with the ground-truth label. The table reports correction rates for each reference classifier.

DatasetResNet-50 correction rate (%)ResNet-101 correction rate (%)
CIFAR-101.8221.822
CIFAR-1008.0328.032
Tiny-ImageNet11.89812.203

87.797%–98.178% of the original training samples retain their soft labels, so DC probabilities still provide soft supervision for most samples. We use ground-truth one-hot labels to correct only the minority with incorrect predictions, ensuring consistency with known labels.

Table 3 supports label correction for improving calibration and accuracy while preserving soft supervision for most samples.

W2/Q3

Thank you for this suggestion. We will consider adding a row with these results to the main results table in the revised version. Note that Table 5 of the current manuscript already reports ECE results for soft labeling without augmentation (Naug=0N_{\mathrm{aug}}=0) across all six settings.

Q4

(1) Validation splits and temperature tuning. As described in Appendix “Experiment Details,” we reserve 5,000 training images for validation on each CIFAR dataset and 10,000 on Tiny-ImageNet, leaving 45,000 and 90,000 for classifier training. We determine the splits using each run's random seed. Model selection and temperature fitting use the validation set, and we fix the selected settings before test evaluation. We select classifiers by validation accuracy and search T∈0.1,0.2,…,10.0T\in\\{0.1,0.2,\ldots,10.0\\} to minimize validation ECE with 15 equal-width bins. All baselines use the same protocol, and Table 1 reports results before and after temperature scaling.

(2) Diffusion model used by CSM. CSM and DiffSL already use the same pretrained EDM weights for image generation on all three datasets. In Table 8, we compare the labeling methods on the same augmented images. DiffSL achieves higher accuracy and lower ECE and AECE than CSM re-annotation.

AuthorsOpenReview ↗

Response to Reviewer yupu (3/4)

Q5

We have rechecked Section 4.3 and confirmed that the construction of qclip\mathbf q^{\mathrm{clip}} and the label correction rule are complete.

For an augmented image mixing classes aa and bb with 0<λ<10 < \lambda < 1, let S=a,b\mathcal S=\\{a,b\\}. We form Sk\mathcal S^k by adding the k−∣S∣k-|\mathcal S| classes outside S\mathcal S ranked highest by reference classifier gg. We renormalize the calibrated DC probabilities over the candidate classes and set all other probabilities to zero. If the DC top-1 prediction lies outside S\mathcal S, correction retains and renormalizes only the probabilities within S\mathcal S, preserving their ratio.

For example, let k=3k=3 and Sk=a,b,c\mathcal S^k=\\{a,b,c\\}. Suppose the normalized DC probabilities for (a,b,c)(a,b,c) are (0.3,0.2,0.5)(0.3,0.2,0.5). Correction produces (0.6, 0.4, 0), even though c has the highest probability. The resulting label remains soft and preserves the relative probabilities of the two generating classes.

We will consider adding this example to the revised version to make the labeling procedure easier to follow.

Q6

Virtual Smoothing (VS; Zhou et al., 2025) and our label correction both use known labels to avoid conflicting supervision. VS assigns smoothing probability to virtual classes and keeps the targets for incorrect real classes at zero, thereby regularizing confidence. DiffSL estimates probabilities over real classes using DC and applies correction only when the predicted class conflicts with the known label set. When the prediction is consistent, the full soft label is retained, including probabilities assigned to other real classes. Our correction therefore allows us to preserve estimated label uncertainty while maintaining consistency with known labels.

VS assigns equal target probabilities to all virtual classes, irrespective of the sample. DiffSL instead estimates a soft label for each image using the learned class-conditional distributions. This data-driven approach aims to better approximate the optimal soft target p(y∣x)p(y\mid\mathbf x) in Section 4.1 by capturing both the uncertainty of each sample and the relative probabilities of competing classes.

AuthorsOpenReview ↗

Response to Reviewer yupu (4/4)

Q7

DC temperature scaling is part of our soft-label construction in Section 4.3. DiffSL classifier predictions use no additional post-hoc temperature scaling. Q2 reports both raw and temperature scaled DC results.

We supplement all methods and all six settings in Table 1 with Brier score and NLL, using the same checkpoints and ten seeds. Parentheses show baseline results after temperature scaling with validation-selected temperatures. The best value for each setting and metric is bold.

Brier score ↓

MethodCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
CE0.0789 (0.0733)0.0810 (0.0746)0.3306 (0.3051)0.3396 (0.3073)0.4662 (0.4648)0.4568 (0.4545)
MMCE0.0789 (0.0733)0.0813 (0.0745)0.3345 (0.3081)0.3415 (0.3072)0.4641 (0.4626)0.4589 (0.4556)
LS0.0803 (0.0810)0.0821 (0.0829)0.3148 (0.3110)0.3361 (0.3280)0.4662 (0.4659)0.4553 (0.4553)
Mixup0.0753 (0.0755)0.0725 (0.0734)0.3069 (0.2981)0.3028 (0.2907)0.4577 (0.4572)0.4476 (0.4472)
FL0.0792 (0.0776)0.0790 (0.0779)0.3013 (0.2989)0.2987 (0.2973)0.4995 (0.4949)0.4874 (0.4837)
FLSD0.0796 (0.0778)0.0789 (0.0780)0.3064 (0.3041)0.3016 (0.3006)0.5015 (0.4968)0.4901 (0.4863)
MbLS0.0828 (0.0828)0.0825 (0.0825)0.3175 (0.3175)0.3323 (0.3323)0.4693 (0.4692)0.4576 (0.4576)
CALS0.0819 (0.0768)0.0827 (0.0772)0.3263 (0.3051)0.3421 (0.3127)0.4685 (0.4685)0.4579 (0.4579)
RankMixup0.0899 (0.0857)0.0920 (0.0889)0.3433 (0.3234)0.3464 (0.3233)0.5190 (0.5190)0.5071 (0.5072)
SKMixup0.0785 (0.0769)0.0766 (0.0751)0.3089 (0.3079)0.2944 (0.2942)0.5204 (0.5060)0.5018 (0.4886)
CSM0.0629 (0.0630)0.0622 (0.0623)0.2947 (0.2947)0.2942 (0.2938)0.4601 (0.4593)0.4486 (0.4467)
DiffSL0.07180.07210.27200.26910.43010.4679

NLL↓

MethodCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
CE0.2034 (0.1623)0.2205 (0.1686)0.9751 (0.8901)1.0249 (0.8983)1.4129 (1.4047)1.3789 (1.3666)
MMCE0.2041 (0.1628)0.2282 (0.1715)0.9905 (0.9015)1.0323 (0.9072)1.4081 (1.3977)1.3899 (1.3726)
LS0.2198 (0.2142)0.2247 (0.2206)0.9718 (0.9799)1.0484 (1.0360)1.4303 (1.4278)1.3942 (1.3942)
Mixup0.1767 (0.1763)0.1769 (0.1736)0.8348 (0.8313)0.8242 (0.8129)1.3842 (1.3817)1.3448 (1.3422)
FL0.1895 (0.1649)0.1870 (0.1655)0.8053 (0.7774)0.8036 (0.7772)1.4907 (1.4821)1.4450 (1.4382)
FLSD0.1908 (0.1658)0.1877 (0.1671)0.8173 (0.7900)0.8097 (0.7852)1.4935 (1.4864)1.4536 (1.4481)
MbLS0.2200 (0.2200)0.2198 (0.2198)1.0226 (1.0226)1.0709 (1.0709)1.4350 (1.4346)1.3914 (1.3914)
CALS0.2174 (0.1797)0.2255 (0.1822)0.9733 (0.9087)1.0456 (0.9448)1.4249 (1.4249)1.3896 (1.3896)
RankMixup0.2149 (0.1833)0.2195 (0.1975)0.9821 (0.8994)0.9956 (0.8986)1.5920 (1.5920)1.5490 (1.5492)
SKMixup0.1905 (0.1827)0.1886 (0.1817)0.8280 (0.8103)0.7912 (0.7812)1.6150 (1.5576)1.5500 (1.4981)
CSM0.1328 (0.1334)0.1346 (0.1349)0.8033 (0.8015)0.7963 (0.7949)1.4018 (1.3978)1.3622 (1.3545)
DiffSL0.14700.14850.69420.68411.29741.4116

DiffSL achieves the lowest ECE across all six settings, together with the lowest NLL and Brier in the three settings where it also achieves the highest accuracy. Note that NLL and Brier scores are not pure calibration metrics, they reflect a mixture of discrimination and calibration ability. On CIFAR-10 and Tiny-ImageNet with ResNet-101, the lower NLL and Brier of some baselines accompany their higher accuracy, while DiffSL retains its advantage in confidence calibration.

Reviewer_rNJ6OpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
3
Read review
Paper summary

Constructs soft labels using diffusion classifier predictions.

The two key innovations stated are: (1) to clip to the top-k classes to be more efficient, and (2) an approach for reprocessing inconsistent classifications between soft and ground truth labels.

Diffusion is a generative method, so builds a distribution as part of the process. This is a reasonable and intuitive way to estimate probabilities for unseen data.

Cites diffusion classifier using a class-conditional diffusion model for classification (Liu 2023, Chen 2024) as a Bayes classifier. This is basically having the diffusion estimate P_{\phi)(y|x)p(y) – where y is the label frequency (often assumed uniform). This is a std approach for Bayesian estimation.

The paper spends time introducing standard diffusion, and KL Loss standard KL Loss from diffusion (eqn 10), temperature scaling (eon 11).

Eqns 12 and 13, 14 are the novel contribution, although this simply clipping and standard loss label assignment. Eqn 15 is the standard mix-up equation applied into a different context.

Critical strengths
  1. Good comparisons with improvements in ECE and uncertainty quantification metrics shown over accurate SOTA models.

  2. Adding the top-K classes and re-establishing incorrect inferred labels with ground truth are novel additions to using post-temperature scaling labels to diffusion as an approach.

Critical weaknesses

The novelty is OK here, but not very large. The paper adds temperature scaled values to the start of the diffusion process, and then makes two changes to limit the total number of classes to ease computational cost and replacing incorrect labels with ground truth as the innovations.

The paper spends a lot of time introducing standard equations.

I sit on the border of accept / reject for this paper.

Questions for authors

As stated above, my reading is that the novelty is not high here. Please correct if I have missed something.

1 comment

We thank the reviewer rNJ6 for the constructive feedback and recognition of our empirical improvements.

DiffSL makes substantive contributions to model calibration:

A data-driven principle for soft labeling. Our analysis in Section 4.1 shows why soft labels that approximate true class probabilities can alleviate overconfidence. This motivates estimating label uncertainty from data, addressing the limitations of heuristic labeling rules in representing the uncertainty of individual samples.

Diffusion models for soft-label generation. As far as we know, we are the first to use class-conditional diffusion models to generate soft labels for calibration training. These models learn class-conditional image distributions, allowing us to estimate class probabilities from the content of each image. The resulting soft labels express both confidence and the relative probabilities of competing classes. This provides supervision that can reflect differences in label uncertainty across samples, including samples from the same class. We apply this principle to both original and augmented data.

Strategies tailored to diffusion soft labeling. We develop top-k class clipping to constrain the class range and reduce labeling cost, label correction to maintain consistency with known labels, and inter-class augmentation to provide samples with class uncertainty. These are novel and effective strategies specifically developed for diffusion-based soft labeling.

These contributions together form a new calibration algorithm. Its key ideas concern how soft labels are generated and used, making a description in words and algorithmic steps more informative than additional equations. We will streamline the standard derivations to foreground these methodological contributions.

Reviewer_q54YOpenReview ↗
Rating
3
Confidence
2
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

The paper proposes Diffusion Soft Labeling (DiffSL) a method to improve the calibration of neural network classifiers. Instead of training with hard labels, the method uses a pretrained diffusion model to generate soft labels that assign different probabilities to different classes. To make this process more efficient and reliable, the authors introduce a novel top-k class selection and a label correction step based on ground-truth labels. They also generate additional training images by mixing information from two classes.

Critical strengths

a. The method provides a novel approach to leverage the knowledge of a generative model into a classifier by generating soft-labels. b. Strong empirical results supported with variance estimates.

Critical weaknesses

a. It is unclear how diffusion soft labels reflect true label uncertainty. This appears to be the main claim of the paper. It is not established by any probing experiments.

b. Which contributes more - diffusion soft-labels or data augmentation. Table 4 results make a strong case for augmentation.

Questions for authors

a. Soft-label quality: What is the evidence that diffusion-based soft labels are a better approximation of the true class probabilities rather those from a discriminative classifier? b. Label Correction: Why did the paper introduce Label Correction. What percentage of samples require label correction? Since correction can turn soft labels into one-hot labels, how does this affect the motivation for using soft labels? c. Augmentation: How much of the improvement in calibration can be attributed diffusion-based soft labeling and how much to augmentation. d. What is the computational cost of using a diffusion model for calibration. How does compute compare with other methods that are not diffusion-based.

1 comment

We thank the reviewer for carefully reading our paper and providing constructive feedback.

a. Soft-label quality.

We directly compare DC and a pretrained ResNet-56 discriminative classifier after temperature scaling. For each CIFAR test set, both models use 2,000 images for NLL-based temperature fitting and the remaining 8,000 for evaluation.

DatasetModelACC (%) ↑ECE (%) ↓NLL ↓Brier ↓
CIFAR-10ResNet-5694.510.97350.18710.0842
CIFAR-10DC93.910.59450.17760.0884
CIFAR-100ResNet-5672.462.82221.05360.3846
CIFAR-100DC80.542.69400.76440.2794

Lower ECE and NLL on both datasets support the quality of DC probability estimates.

Our soft-label source ablation in Table 2 provides evidence for the effectiveness of diffusion soft labels. Under identical training conditions without augmentation, both EDM and DDPM soft labels improve classifier calibration over pretrained-classifier labels, further supporting the calibration benefit of training with diffusion-based soft labels.

b. Label correction.

Our motivation is to estimate label uncertainty following a data-driven principle while ensuring consistency with ground-truth labels. DC can assign the highest probability to an incorrect class, introducing conflicting supervision. Samples whose predictions agree with the known labels retain their soft labels unchanged.

The table below shows correction rates on original training data.

DatasetResnet-50 (%)Resnet-101 (%)
CIFAR-101.8221.822
CIFAR-1008.0328.032
Tiny-ImageNet11.89812.203

87.797%–98.178% of original samples retain their soft labels. We use ground-truth one-hot labels to correct the minority of samples whose predicted classes disagree with the known labels.

In Table 3, correction improves ResNet-50 accuracy on all three datasets and reduces ECE from 0.49% to 0.42% on CIFAR-10, 1.95% to 1.08% on CIFAR-100, and 2.99% to 1.12% on Tiny-ImageNet. These results support using known labels to correct conflicting predictions while retaining soft supervision for the majority of samples.

c. Soft labeling and augmentation.

We use DC to assign soft labels to original training data and apply the same procedure to inter-class augmented samples. These images do not have any ground-truth class labels and therefore also require a labeling strategy such as our soft labeling. Augmentation provides additional samples with class uncertainty, and DC supplies their soft labels for training. The benefit therefore depends on both generation and labeling.

In Table 4, “One-hot + augmentation” uses one-hot labels for original samples and DC soft labels for augmented samples. On CIFAR-100/ResNet-50, soft labeling the original data reduces ECE from 11.93% to 5.16% without augmentation and from 2.72% to 1.08% with the same augmented data and labels. Adding augmentation to soft labeling reduces ECE from 5.16% to 1.08%.

In Table 8, replacing CSM re-annotation with DC soft labels on the same generated images reduces ECE from 2.87% to 1.08% and raises accuracy from 78.43% to 80.61%, supporting the benefit of our soft labeling for augmented samples.

d. Computational cost.

DiffSL involves labeling and classifier training. We generate soft labels with RDC's off-the-shelf diffusion model. Soft labeling is a one-time cost for each dataset and configuration, after which the labeled dataset can be released for reuse. Without augmented data, classifier training costs are comparable to other methods.

The table below estimates augmented data generation(w/ labeling) costs in GPU-hours on NVIDIA RTX 4090. Labeling uses selected temperatures and top-15 on CIFAR-100/Tiny-ImageNet. A dash means no augmentation.

Cost componentCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
Original data labeling14.1814.1826.1025.8967.8967.66
Full pool generation (w/ labeling)——23.0723.19266.61—

The table below reports estimated GPU-hours per training run. Parentheses indicate the number of augmented images used per original image.

MethodCIFAR-10 (ResNet-50)CIFAR-10 (ResNet-101)CIFAR-100 (ResNet-50)CIFAR-100 (ResNet-101)Tiny-ImageNet (ResNet-50)Tiny-ImageNet (ResNet-101)
Label smoothing3.405.843.475.936.6110.14
Focal loss3.375.923.545.986.6210.12
CE + TS3.365.863.456.006.6010.14
DiffSL3.285.798.08 (NaugN_{\mathrm{aug}}=2)12.57 (NaugN_{\mathrm{aug}}=2)12.24 (NaugN_{\mathrm{aug}}=1)10.25

Classifier training and inference need no diffusion computation.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.