- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies worst-case contrast, i.e., whether is above or below a threshold. It provides SENSITIVE, INSENSITIVE, or UNRESOLVED reports and confidence bounds under the stated setting and assumptions. Additionally, it analyzes adaptive sampling/placement, presenting a cap-packing lower bound and a doubling-tree upper bound. Performance evaluation is reported using synthetic experiments.
Critical strengths
The paper derives an adaptive query-complexity lower bound and a doubling-tree upper bound. These bounds appear to be meaningful contributions, though the constants are loose.
The paper characterizes the full range of worst-case effects consistent with those bounds, considering a fixed set of confidence intervals at sampled settings and a known Lipschitz bound.
Critical weaknesses
The reviewer found the paper quite difficult to follow and comprehend, and it is difficult to identify the main idea or concept, making the contributions difficult to assess and validate.
One concern of the reviewer regards the practical relevance of the presented analysis, i.e. the assumptions seem quite restrictive, which limits applicability. For instance, the authors assume an externally validated global Lipschitz constant and require fresh joint interventions fixing every nuisance coordinate.
The novelty appears to be limited in the fixed-grid results. The confidence bounds combine standard arguments (concentration and Lipschitz covering); the exact envelope result applies classical McShane–Whitney extensions. The empirical evaluation is synthetic and relatively limited, and the paper also does not show a practical advantage over existing Lipschitz methods (the proposed method is not shown to outperform Lipschitz placement, at least in the larger reported budgets).
Questions for authors
Q1: What specific guarantee in Theorems 4C–4D is not covered by existing certified Lipschitz optimization methods?
Q2: Can you give a realistic setting where the required joint interventions and externally validated Lipschitz constant are available?