- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors provide a diffusion model that explicitly models sparsity by diffusing discrete SBs along continuous variables in a shared continuous state-space. The Sparse Data Diffusion (SDD) model aims to generate sparse data. The SDD extends continuous state-space diffusion models with an explicit representation of exact zeros by modeling sparsity through the introduction of Sparsity Bits.
Critical strengths
- The problem of generating sparse data is interesting.
- The paper is clearly presented.
Critical weaknesses
- The main concern is the novelty of the work. In terms of the technical contribution, the proposed SDD method is a limited extension of the previous diffusion model.
- The effect of the SDD model largely depends on the denoising neural network . However, the design of is not discussed.
Questions for authors
Please justify the proof of proposition1. The current version is not very clear.
We thank Reviewer uMQm for the feedback and address each concern below.
Novelty
SDD is intentionally simple, but to our knowledge it is the first diffusion model to jointly diffuse discrete and continuous variables in a shared continuous state space (Section 4). Without domain-specific design, it outperforms domain-specific and sparsity-aware baselines.
Denoising network design
Section 3.1 (paragraph "DM architecture & training") describes the denoising networks. SDD uses the same architectures as the DDPM/DDIM baselines, changing only the input and output dimensions, which isolates the effect of the Sparsity Bits. Full details are in the supplementary code.