- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Scheduler-Corrected Gibbs Sampling (SCG), a Gibbs sampling method that mitigates the underestimation of the number of clusters caused by state-dependent Same-Group-First (SGF) scan order. The authors first analyze why the SGF scan order can lead to underestimation of the number of clusters. They then propose SCG, which corrects the state dependence of the scheduler through a Metropolis-Hastings correction. To avoid zero reverse support and control the rejection rate, they replace strict SGF with a soft Plackett-Luce scan distribution. Experiments on synthetic CRP settings and the sklearn digits dataset validate the correctness and behavior of the proposed method.
Critical strengths
The core theoretical formulation appears to be sound, and the proposed correction and supporting derivations are generally clear and mathematically coherent.
Critical weaknesses
-
Unclear motivation for the SGF scan order. The paper assumes that large-scale distributed inference with strict data locality naturally induces a Same-Group-First scan, where all customers assigned to the same cluster are updated contiguously. However, the connection between locality and this specific scan order is not sufficiently justified. In a genuinely parallel setting, different workers may process their clusters at the same time, resulting in an interleaved sequence of customer updates across clusters.
-
Questionable practical benefit of the proposed correction. Although improving the efficiency of large-scale distributed inference is a central motivation of the paper, the proposed correction introduces additional costs. First, the MH step may reject an entire Gibbs sweep after its computation has already been performed. Second, using a soft scheduler to maintain reverse support also weakens the strict locality of SGF, potentially reducing the parallel efficiency. It is therefore unclear whether the resulting tradeoff offers an efficiency benefit for large-scale parallel inference.
-
Weak support for the fragmentation diagnostic. The analysis in Sec. 2.3 shows that contiguous partitions become increasingly rare among all possible partitions, but its connection to SGF-induced cluster loss is not sufficiently established. The subsequent empirical analysis only shows a correlation between the proposed fragmentation severity and the cluster retention ratio. However, both quantities may be jointly affected by and . Therefore, the observed correlation does not establish that fragmentation severity itself causes the under-fragmentation. Compared with the more direct occupancy-drift analysis in Sec. 2.2, it is unclear what additional insight this diagnostic provides
Questions for authors
-
The paper uses the CRP distribution and related quantities throughout the theoretical analysis without formally introducing the underlying process. A brief definition would improve the clarity of the paper.
-
The transition from the forward-reverse symmetry of random-scan Gibbs to the proposed MH correction in Sec. 3 could be explained more clearly, including its connection to existing MCMC techniques.
-
Several equation references are incorrectly formatted as "Eq. equation 1/2/3".