- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a way to conditionally generate continuous tabular columns subject to provided constraints (in the form of other tabular columns). The standard way to generate data via diffusion/flow matching is to start from a white noise prior and gradually shift this towards the data distribution by parameterising the learned backbone on the context/constraints C. This paper proposes an alternative wherein the parameter C is removed from the backbone by changing the initial prior distribution to be conditional on the context. This is achieved by introducing CS-forcing loss to improve training stability under such scenarios. There are theoretical and empirical results to validate the proposed approach and results against the baselines are strong. However, there are several key evaluations which are missing, prompting me to give this work a weak reject.
Critical strengths
- The empirical results are promising
- The idea is intuitive and the theoretical results offer useful insights.
- There are useful ablation studies which help to evaluate the contributions from several angles.
Critical weaknesses
-
A key weakness of the method is that it assumes the context C will always be available during inference. Hence the method cannot do unconditional generation, i.e., when there is no context provided. There are alternative methods that can train on the full table distribution [1, 2] and constrain their generation on the available context at inference-time, allowing them to do both conditional and unconditional generation. Such approaches can treat the provided context as observed cells (like a tabular imputation task). Comparisons with such methods are absent.
-
It is unclear if CS-Forcing is generalisable to other approaches. For example, a comparison against TabDDPM or TabDiff using the same CS-Forcing loss would help establish whether the loss function generalises to other approaches of training diffusion models.
-
CS-Forcing introduces additional parameter complexity and runtime overheads when training the model. This casts doubt over the practical feasibility of the proposed method since these overhead costs are not empirically evaluated.
-
The definition of conditional generation used in the paper is somewhat limited. Other works, e.g. [2], consider conditional generation to include imputation constraints, inequalities, conjunctions, or disjunctions of constraints. The proposed work is conditional in the sense that the generated columns are conditional on the fixed attributes, but it cannot handle the more general types of constraints.
-
The code is not available for review.
-
The background on diffusion and flow matching models is somewhat limited for readers outside the field to follow.
References [1] Zhang, Hengrui, et al. "Diffputer: Empowering diffusion models for missing data imputation." International Conference on Learning Representations. Vol. 2025. 2025.
[2] Shankar, Aditya, et al. "Harpoon: Generalised manifold guidance for conditional tabular diffusion." International Conference on Learning Representations. Vol. 2026. 2026.
Questions for authors
See weaknesses