- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The problem addressed in the paper is the most probable explanation (MPE) inference in probabilistic graphical models (PGMs). The approach taken considers a power family of conditional probabilities parametrized on a parameter \beta taking integer positive values. A consequence of the actual formula used (with a conditional probability raised to the power of \beta) is that as \beta grows sampling gets biased towards MPE solutions, as in a sense using a power (and then normalizing the resulting values back into a probability distribution) amplifies the gap between various probability values in a distribution. A neural sampler is trained with a reverse (exclusive) KL minimization. Training creates a so-called ladder of proposals, meaning that a checkpoint model is stored for each value \beta within one global training. During inference, the sampler is used to draw samples, and a highest-scoring assignment is returned. An empirical evaluation is performed on PGMs of several types, including the grid family, the graph coloring family and synthetic spin glasses on 6-regular graphs. The evaluation includes a comparative analysis of checkpoints, followed by a best-of-K analysis for single-shot MPE inference. The evaluation further contains analyses focused on test-time training, warm-start annealing and branch-and-bound variable ordering.
Critical strengths
The empirical analysis is rather broad in terms of the types of studies, with dedicated sections on multiple analyses, as mentioned in the summary of the review. Results show benefits on top of baselines considered. The technical approach appears to be sensible.
Critical weaknesses
The paper is difficult to follow for an audience that exceeds a circle of experts, and it give the impression that it is written for an expert audience. For example, some technical concepts are used without any introduction, including central concepts such as node discovery. The conclusion of some of the empirical analyses as well as the significance of some of the results are not clearly articulated (e.g., Table 1). Figures have a poor size/resolution of fonts, making them impossible to interpret unless the reader zooms into the pdf document.
Questions for authors
No specific questions to the authors.
2 comments
Thank you for the response, I confirm reading and considering it.
Response to Reviewer DDTz
We thank the reviewer for the careful reading. The concerns are about presentation, and we address each below.
Undefined central concepts
We will define each central concept at first use and add a short notation table and a plain-language method overview before the formal objective. In particular:
Articulating the conclusions, including Table 1
We will add an explicit takeaway to each analysis. For Table 1, the point is that a single training run yields a whole family of proposals indexed by β, and the table shows how the deployed power is chosen. Reading across β, diversity (the mean per-site Gini index) falls monotonically as β grows, while best-of-128 validation logP improves and then turns over on the more multimodal instances. This exposes a concentration-versus-coverage trade-off and identifies, per instance, the validation-selected power (bold, the row maximum in logP) used at deployment. We will state this conclusion in the caption and the surrounding text, and do the same for the other analyses so each section ends with its result in one sentence.
Figures
We will regenerate all figures with substantially larger axis, tick, legend, and annotation fonts, and export them as vector (resolution-independent) graphics so they are legible at normal zoom. We will also thin the densest panels so individual series are distinguishable in print.
General readability
We will restructure the method and experiments for a broader audience, leading with an intuitive overview of the power-sampling idea before the formal objective, defining notation on first use, and signposting what each experiment establishes. The goal is that a reader outside the immediate subarea can follow the main argument without reconstructing the terminology.
Summary
The concerns are presentation, and the revision will define the central concepts (including mode discovery) at first use, articulate the conclusion of each analysis including Table 1, enlarge and vectorize the figures, and add a plain-language overview and notation table. None of these change the results. They make the paper readable outside the immediate subarea.