- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Jumping Up and Down (JUD), a diffusion model for discrete ordinal data. It combines Binomial-Poisson or Poisson-Poisson corruption with two latent denoisers that estimate the removed and added counts. Experiments include eight synthetic distributions, unconditional CIFAR-10 generation, and hard Sudoku completion. The Binomial-Poisson model achieves a CIFAR-10 FID of 2.07 on 50,000 generated images and a mean Sudoku accuracy of 66.99% with posterior cross-entropy training and digit shuffling.
Critical strengths
- Theorem 2.1 gives explicit reverse-time rates in terms of the expected added and removed counts. This provides a concrete link between simple denoising losses and bidirectional sampling.
- The authors conduct extensive experiments and the results are promising. Table 2 reports a CIFAR-10 FID of 2.07, the lowest among the discrete models. These results provide useful evidence that the construction can generate competitive images.
Critical weaknesses
- The ablation studies are not clear enough. The CIFAR-10 comparison does not isolate the benefit of bidirectional corruption. Appendix G.3 varies the sampler but does not report a Binomial-only model using the same backbone, preconditioning, time-sampling policy, and training budget.
- The strongest Sudoku result uses shuffled digits, but Appendix H.1 also changes the updates from 10,000 to 20,000, the learning-rate schedule from cosine decay to constant, and weight decay from 0.05 to zero. The comparison in Table 3 therefore does not isolate digit shuffling, and does not establish a matched training comparison with the published diffusion baselines.
Questions for authors
- Is a Binomial-only CIFAR-10 result already available under the same backbone, preconditioning, training-time proposal, and training and sampling budgets as JUD? Please identify any existing matched control and clarify which of these settings are shared by the Binomial Flow result in Table 2.
- Does the Sudoku comparison include the update-count, learning-rate, and weight-decay changes described in Appendix H.1?
- What noise parameters and initialization were used for the Poisson-Poisson column of Table 1?
3 comments
Most of my concerns have been addressed in the author response.
We thank the reviewer for the acknoledgment.
Questions For Authors:
- Is a Binomial-only CIFAR-10 result already available under the same backbone, preconditioning, training-time proposal, and training and sampling budgets as JUD? Please identify any existing matched control and clarify which of these settings are shared by the Binomial Flow result in Table 2.
This requested controlled experiment has been carried out (see "Up-Down vs Down-Only Process on CIFAR-10" section above) and added to the revised manuscript. We have also commented in detail about the remaining differences between this control and the original Binomial Flow implementation, which explains the FID differences, and clarified the extent to which the Binomial Flow already followed the same approach of JUD with a zero poisson rate.
- Does the Sudoku comparison include the update-count, learning-rate, and weight-decay changes described in Appendix H.1?
All the Sudoku results in the revised manuscript and in the section "Controlled Sudoku Shuffling" above now use identical training and inference configurations. We have additionally added the permutation-shift results to all baselines, which allows to isolate the impact of digit shuffling across all methods.
- What noise parameters and initialization were used for the Poisson-Poisson column of Table 1?
We have clarified what the experiment in the original and revised manuscripts use in the "Poisson-Poisson Performance and Settings, Other Changes and Results" section above.
We would like to enquire with the reviewer what specific concerns remains unresolved (as most concerns have been addressed in the author response).
Addressing reviewer's points
All Points
Please see the Addressing major points raised by multiple reviewers thread above where we address major points raised by multiple reviewers. In case anything is unclear or further discussion is warranted please let us know.