- Rating
- 2(+1)
- Confidence
- 2(+1)
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates whether batch measurement selection can capture value that arises only when multiple measurements are acquired jointly. The authors demonstrate that, under the conditions considered, the submodularity ratio of the closure objective is zero, rendering traditional theoretical guarantees based on positive submodularity ratios inapplicable. The paper distinguishes between two types of obstacles—insufficient low-order information and restricted small-scale swaps—and presents results on exact recovery and global optimization for designs with specific pairwise graph structures.
Critical strengths
The authors validate, using real-world data, a scenario where improvement is impossible via single- or double-measurement swaps but achievable through triple-measurement swaps. Furthermore, altering interference correlations while keeping individual scores constant reverses the gains from such swaps, providing compelling evidence for the role of joint geometric structure.
Critical weaknesses
Concepts such as closure, witness, information order, and swap scale are introduced in rapid succession, making the material challenging to grasp. It is recommended to include a simple numerical example prior to the formal definitions and to use a unified diagram to illustrate the relationships between the theorems.
Additionally, it is suggested to strengthen the discussion regarding recent research on batch active learning and experimental design, thereby more clearly articulating the paper's innovations and positioning relative to that work.
Questions for authors
When accounting for overheads such as proposal generation and coefficient optimization, do the advantages of witness swaps over baseline methods—specifically simulated annealing and sparse recovery—persist under a fixed end-to-end time budget?