- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper develops a diffusion model for tabular generation that is capable of conditional generation, and a variant of the Shape metric that is not dominated by common subpopulations (seemingly similar to balanced accuracy in classification). The paper also has a theoretical analysis showing that under suitable assumptions, cross entropy is a better loss than mean-squared error (MSE) for generating categorical variables, contradicting the common idea that MSE is the loss of choice for diffusion models. The paper has experiments comparing the model to baselines on both conditional and unconditional generation, and two case studies showing that that the synthetic data from the model replicates findings in econometric studies.
Critical strengths
The paper is easy to follow and presents clear arguments. The case study showing how the model could be used as a synthetic control is especially informative.
Critical weaknesses
The comparisons experiments are not very comprehensive: the paper only uses four datasets which are all derived from US Census data. For a comparison, Mueller et al. (2026) use 12 datasets from several domains. The selection of baselines is also limited: two for the unconditional case and one (excluding the idealised baseline and variants of the paper's model) for conditional generation. For example, ARF (Watson et al. 2023) is typical baseline missing from the paper. In addition, current tabular in-context supervised learning models like TabPFN (Grinsztajn et al. 2026) are very strong and quickly handle large datasets. Any such model can be used to generate synthetic data unconditionally, or with equality conditions, by sequentially predicting each column from already generated columns (for unconditional generation the first column can be sampled from the data). Synthpop (Nowok et al. 2016) is an example of this approach with tree-based predictors. These are easy enough to deploy due to in-context learning that at least one model of this type should be included as a baseline.
The proposed conditional shape metric is motivated by arguing that it does not dominated by common subpopulations, but this argument is not verified in any way. The definition of conditional shape for numerical columns needs to be clarified. It is not clear how it would be computed based on the description for categorical columns, since that description relies on the fact that there is a finite number of categories.
The paper does not clearly distinguish novel components of the model and training setup, so it is difficult to evaluate how interesting they are to the research community.
Minor points:
- Figure 3: the lines are hard to distinguish.
- Figure 3: to my understanding, the wage numbers are inflation-adjusted, but minimum wages are not, so the plotted minimum wage line is not directly comparable with the other lines.
References:
- Nowok, Beata, Gillian M. Raab, and Chris Dibben. “Synthpop: Bespoke Creation of Synthetic Data in R.” Journal of Statistical Software 2016
- Watson, David S., Kristin Blesch, Jan Kapar, and Marvin N. Wright. “Adversarial Random Forests for Density Estimation and Generative Modeling.” AISTATS 2023
- Grinsztajn, Léo, Klemens Flöge, Oscar Key, et al. “TabPFN-3: Technical Report.” arXiv:2605.13986. 2026
Questions for authors
- The paper weights the numerical and categorical losses equally. Have you experimented with other weightings?
- What does Figure 3 look like if the y-axis is not cut off at 0.3 and plotted all the way to 1, as CDFs are usually plotted?
4 comments
Thank you for the response and the additional experiments. They make the performance improvement of DiffLTM compared to other diffusion models much clearer. However, I disagree with some of the points in the response.
We deliberately decided to focus our comparisons to state-of-the-art continuous/discrete diffusion models.
If all tabular diffusion papers did this, the field could miss another model family surpassing them, and get stuck developing suboptimal models. The baselines should be chosen based on the specific problem and operational constraints like required compute, but not the model family they represent.
(I'm not suggesting you should compare against synthpop, I cited it to show that sequential generation is not a new idea.)
It is mathematically trivial that conditional shape is less dominated by common subpopulations.
I don't think it is trivial at all because of possible interactions between columns. For example, consider data with two categorical variables and , where 1% of the population has , everyone with has , and the values for people with are uniformly distributed. It's true that the subpopulation has equal weight when conditioning on , but they only have 0.1% of the weight when conditioning on .
The paper also does not explicitly state that a subpopulation is defined based on the value of exactly one column. A subpopulation based on a rare combination of values, where none of the those values is by itself rare, would not have equal weight.
As a result, the claim needs supporting evidence. For example it could be a theorem that formalizes what exactly does "all subpopulation receive equal weight" mean and proves CShape does that. Or it could be a controlled experiment where it is clear what a metric weighting all subpopulations equally should do, and CShape does that, but Shape does not.
Plotting the full CDF makes these changes harder to visually distinguish, and adds nothing substantial.
You could still add the full CDF plots to the Appendix so readers can evaluate whether they have anything substantial themselves.
-
We agree with the general methodological point that comparisons should not be limited to a single approach. On the other hand, comparisons cannot be exhaustive, and we tried to strike a middle ground. The TabCascade paper has carried out comaparisons with ARF in earlier work and obtained better results with diffusion-based methods. We will test ARF on our datasets as well in the final version of the paper.
-
We will add a formal statement characterizing the reweighting factor that is introduced by the conditional shape metric, and the sense in which it is more focused on subpopulations.
-
We will report the full CDFs in Appendix as suggested.
Thank you, this addresses the remaining concerns I had, so I've raised my score.
We thank the reviewer for the remarks and respond to their questions below :
Additional baselines.
We carried out new comparisons with two new diffusion based models: CDTD and TabDiff on ACSLabour Dataset (with additional CShape Rare metric). The conclusions are unchanged. See table below. This is also added to Table 1 of the revised paper.
Sequential generation. We carried out a comparison with one the best tabular foundation model (TabPFN-3.5).
It is incorrect to claim that TabPFN has comparable inference time performance.
Comparison to ARF and Synthpop. We deliberately decided to focus our comparisons to state-of-the-art continuous/discrete diffusion models. We do not think that it is possible to be entirely exhaustive in such a publication.
Conditional shape. This question is very puzzling. It is mathematically trivial that conditional shape is less dominated by common subpopulations Consider for instance a categorical variable taking 4 values, with frequencies (0.7,0.2,0.05,0.05). Shape weighs the 3 subpopulations by (0.7,0.2,0.05,0.05). Conditional shape weighs them by (0.25,0.25,0.25,0.25).
We also use 'conditional shape on rare' that weighs them by (0,0,0.5,0.5).
The definition for conditional shape on rare for numerical columns can be given by binning. We will add this in the next iteration.
Weights for numerical and categoricals. We carried out some experiments using different weights, but did not observe an obvious improvement. We believe this is in fact one advantage of using continuous diffusions both on numerical and categorical variables.
CDFs plots. We zoomed into the lower tail since that is where minimum-wage related changes are typically most concentrated. Plotting the full CDF makes these changes harder to visually distinguish, and adds nothing substantial.