- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper shows whether randomizing the order of parallel sampling improves the accuracy of a sampler. The authors consider a specific case where the sampler is non-correcting, -step, with exact conditional distributions. The paper shows that randomized sampler can be superioir to deterministic samplers with quantitative results on forward Kl and entropy. Lastly, the authors propose a sampler that combines randomly choosing the initial batch and filling the midpoint values.
Critical strengths
S1. The paper studies the theoretical behaviors of randomized and deterministic sampler in a different settings. The theoretical results clearly show why randomized sampler can improve sampling accuracy which the deterministic sampler counterpart cannot achieve.
Critical weaknesses
W1. Restrictive assumptions. The analysis assumes access to exact conditional distributions, independent sampling, and a non-correcting sampling that does not revise already sampled values. The paper does not establish whether the presented superiority of randomness persist with approximate learned conditionals or sampling procedures that allow revisions. Therefore, the setups considered in the paper remain relatively simple and far from real world applications. The randomized error bounds are established primarily for positively correlated binary chains, while the initial-entropy theorem is restricted to symmetric binary chains. Extending these conclusions to broader dependencies would strengthen the paper. Overall, I find the presented results of the paper lack practical usability in real world scenarios.
W2. Limited practical evaluations. The evaluations focus on short binary chains and provide useful validation results through exact comparisons. However, the paper does not evaluate the proposed sampler on learned generative models or realistic datasets, nor compare its practical performance with confidence-based or entropy-based scheduling methods which are widely used in practice. Consequently, the experiments provide limited evidence that the theoretical advantage translates into improved sampling quality or efficiency in practical applications.
Questions for authors
None. Please see the weaknesses.