- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Generalized Differentiable Hamiltonian Dynamic Nested Sampling (GDHDNS), a framework for efficient Bayesian evidence estimation and posterior sampling. The proposed method combines covariance-based preconditioning, persistent reflective Hamiltonian dynamics, and preconditioned slice sampling to improve exploration of likelihood-constrained regions. It further introduces batched live-point replacement with a corresponding prior-volume shrinkage schedule and provides evidence gradients by differentiating a weighted likelihood estimator while holding sampler decisions fixed. The authors evaluate the method on synthetic distributions, gravitational lensing reconstruction, Lennard-Jones potentials, and a hierarchical stochastic differential equation model. The experiments demonstrate promising computational efficiency and evidence accuracy across several settings, although limitations remain in high-dimensional and multimodal problems.
Critical strengths
(1) A practically motivated combination of complementary sampling techniques. The proposed framework addresses important computational challenges in nested sampling by combining adaptive geometric preconditioning with reflective Hamiltonian dynamics and slice-based exploration. Using the empirical covariance of live points to construct the mass matrix is an appealing way to adapt to the geometry of the constrained region without requiring Hessian information. The batched replacement strategy also provides a practical mechanism for exploiting parallel computation. These design choices are well motivated by the computational bottlenecks of existing nested sampling methods.
(2) Broad empirical evaluation with meaningful accuracy diagnostics. The paper evaluates evidence estimation against analytically tractable references and considers challenging problems involving anisotropic, hierarchical, and multimodal distributions. Importantly, the experiments assess evidence accuracy in addition to computational efficiency, which is essential because accurate posterior reconstruction does not necessarily imply accurate marginal likelihood estimation. The authors also discuss settings where the method encounters difficulties, providing useful insight into the limitations of the proposed approach.
Critical weaknesses
(1) The stationary-distribution guarantees of the proposed constrained-sampling kernel are not sufficiently justified. The paper claims that the combination of reflective Hamiltonian dynamics and preconditioned slice sampling preserves the constrained prior distribution. However, the described slice-sampling procedure uses bracket doubling followed by shrinkage without specifying the additional acceptability test required by Neal's doubling construction for general disconnected slices. Consequently, the claimed invariance does not directly follow for arbitrary constrained regions. Furthermore, the method carries momenta across sampling iterations while recomputing the mass matrix from the evolving live-point covariance. Partial momentum refreshment does not generally preserve the required Gaussian momentum distribution when the mass matrix changes, unless an appropriate transformation or correction is applied. These issues are consequential because the correctness of the nested sampling evidence estimator depends critically on generating valid samples from the likelihood-constrained prior.
(2) The empirical contribution of the proposed components is not sufficiently isolated from existing methods. Although the paper reports substantial computational improvements, it does not directly compare against Gradient-Guided Nested Sampling (GGNS), which is presented as the closest methodological predecessor and a special case of the proposed framework. Moreover, the experiments lack systematic ablations separating the effects of covariance preconditioning, reflective dynamics, slice refreshment, momentum persistence, and batched replacement. Without these comparisons, it is difficult to determine which components are responsible for the reported improvements and whether the gains arise from the proposed sampling mechanism or primarily from implementation-level optimizations. Additionally, the differentiable evidence estimator relies on a standard posterior-weighted score identity with fixed sampling decisions, making its distinct theoretical contribution less clear.
Questions for authors
(1) Correctness of the slice-sampling update. Does the implementation include the additional acceptability test required by Neal's bracket-doubling procedure? The described algorithm appears to accept a candidate immediately upon satisfying the likelihood constraint, without checking whether the same bracket could have been generated from the proposed state. For disconnected slices, this can violate detailed balance. Could the authors clarify the exact procedure and provide a justification for invariance under general non-convex or disconnected constraints?
(2) Invariance under adaptive mass matrices and persistent momentum. How does the proposed kernel preserve its joint stationary distribution when the empirical mass matrix changes between generations while momentum is retained? If the previous momentum follows and the new refreshment noise follows , the partially refreshed momentum generally has covariance , rather than . Is an additional momentum transformation or resampling step applied in the implementation? If not, could the authors explain why this does not affect the claimed stationary-distribution guarantee?
(3) Comparison with the closest predecessor and component-level contributions. Could the authors provide a direct comparison with GGNS under matched computational budgets and a systematic ablation of the proposed components? In particular, comparing variants with and without preconditioning, slice refreshment, and momentum persistence would help determine whether the improvements arise from better constrained-prior exploration or primarily from vectorization and implementation choices. Such results would materially affect the assessment of the paper's methodological contribution.
Thank you for the detailed response and additional experiments. The GGNS comparison and ablations address my concern about missing empirical comparisons. I also appreciate the clarification that the score identity is not claimed as novel. However, my main concern about the correctness guarantees remains unresolved.
Slice update. The independently expanding bracket differs from Neal’s standard doubling construction, so it requires a separate invariance argument for the implemented procedure. The absence of detectable evidence bias over 20 seeds is reassuring, but does not establish invariance for general disconnected slices. This remains relevant because §4.2, lines 228–230, claims invariance without assumptions on the region’s shape. Could the authors justify the actual update, or replace it with a validated construction and reassess the results?
Adaptive mass matrix and persistent momentum. I accept the pure-scaling argument under an exact reflected flow and a suitable momentum distribution. However, this does not resolve general changes in metric shape. The factor cos2(δ)≈0.13 attenuates the covariance mismatch but does not bound its effect on the position distribution or evidence estimates. Replacing only a fraction of the live points also does not guarantee sufficiently small metric changes. Full refreshment removes this particular mismatch, but its empirical agreement with the default variant does not establish the latter’s invariance. The manuscript should distinguish the fixed-metric argument from the guarantees justified for the adaptive implementation.
Ablations. The new results support the importance of slice refreshment, but provide limited evidence for the additional benefit of the full combination. On the 32-D funnel, removing the reflected flow yields a similar mean evidence error and a smaller observed across-seed standard deviation, while reducing runtime from 31.47 s to 8.82 s. The Gaussian result shows a variance benefit at additional cost. These findings warrant more qualified claims about the benefits of the individual components and the full method.
I truly appreciate the substantive additions, but empirical robustness does not resolve the outstanding invariance questions. I therefore maintain my current rating, while remaining open to a justified or corrected kernel with corresponding validation.