- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Constrained Involutive MCMC (CI-MCMC), which trains neural MCMC proposals with constraints on mode coverage, local fidelity within each mode, and acceptance. It provides a conditional uniform ergodicity guarantee, and empirically evaluates CI-MCMC on synthetic datasets and multiple applications.
Critical strengths
- The constraints are well-motivated to address complementary sampling failures and have a clear connection to the convergence bound.
- Empirical evaluation metrics provide meaningful evidence of improved cross-mode mixing across diverse tasks.
Critical weaknesses
- The setup of numerical experiments seems not to satisfy the assumptions in the theoretical results. For example, Appendix B.6 assumes , which results in in equation 12 and thus contradicts with the assumption in Theorem 1. Furthermore, Appendix B.6.1 reports only 4.7% acceptance, which also violates the required acceptance rate .
- There is no ablation study on the effect of each component in equation 14.
Questions for authors
- Can you explain the mismatch between the theoretical assumptions and numerical results?