- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes QIOCE, a hybrid quantum and classical method for generating counterfactual explanations for a fixed binary classifier on tabular data with continuous and categorical features, encoding continuous features as Ry rotations on one qubit each and categorical features as one-hot registers. Separate parameter sets for the two class transition directions are learned by sequential transfer across training instances, and at test time a local copy is adapted per instance in two L-BFGS-B stages, the first emphasizing target-class validity and the second improving proximity, sparsity and KDE plausibility, before a classical local refiner polishes the decoded candidate. The claimed contributions are a variational initializer with directional parameter transfer and per-instance adaptation, a tabular evaluation that separates the quality of valid counterfactuals from target-class reachability under a shared refiner, and qualitative image counterfactuals and boundary probes on Digits. Validation comprises a quality comparison on seven small tabular datasets against Growing Spheres, Wachter, DiCE, TABCF and Tabular Diffusion over three seeds, where QIOCE gives the lowest distance on five datasets and the lowest plausibility distance on all seven, an initializer comparison on five datasets against six classical initializers under a shared stochastic refiner, where QIOCE gives the highest or joint highest validity on four though at larger distance, stage diagnostics from single runs showing the quality stage can remove validity and that retaining valid candidates mitigates this at extra cost, and a component ablation on Wine alone.
Critical strengths
An original and carefully framed research direction. To my knowledge, using a variational quantum circuit to initialize counterfactual search is a new idea. The design contains several concrete elements: direction-specific parameter transfer with per-instance adaptation, an encoding that handles both continuous and categorical features, and a decoder that requires only single-qubit marginal Z statistics from one measurement batch. The authors explicitly position the method as a candidate-generation heuristic and do not claim computational quantum advantage. This matters because it makes the work a credible starting point for studying quantum initializers in XAI rather than an overclaimed demonstration.
Critical weaknesses
-
The contribution of the quantum component is not demonstrated. The variational circuit has only 2p = 10 parameters shared across all qubits, is fully classically simulable at the evaluated sizes, and its phase layer does not encode the counterfactual objective (as the authors acknowledge). The paper lacks the key control: a classical parametric initializer of the same form and parameter count. The only relevant ablation (Table 7, QIOCE_RandInit) uses a single dataset, a single run, and no uncertainty estimates, and QIOCE does not achieve the lowest refined distance there. Without this control, the observed gains cannot be attributed to the quantum parameterization rather than to the KDE guidance, the refinement stage, or the larger search budget. This is consequential because the quantum initializer is the paper's central claimed contribution.
-
The experimental evaluation is inconsistent and insufficiently controlled.
- Results for the same method and dataset differ substantially across sections (e.g., QIOCE on Wine: L2 0.602 in Table 1, 2.710 in Table 2, 0.781 in Table 7), and it is unclear which configuration constitutes the proposed method.
- Table 1 reports 100% validity for all six methods on all seven datasets. By contrast, the stage study (Figure 5) shows that standard QIOCE reaches only 29/50 valid outputs on Wine after refinement, largely because the quality-optimization stage (Step 2) removes validity obtained in Step 1 (19 → 12 valid). I understand that these studies use different protocols, but this makes it unclear which QIOCE configuration and refiner are evaluated in Table 1 and how it reaches 100% validity. The authors should clarify this and state whether any instance filtering was applied.
- The Sparsity column in Table 1 shows an unusual pattern: every mean, averaged over three seeds and many per seed, ends in a zero in the hundredths place (e.g., 9.10 on Diabetes with n = 133), and the standard deviations take only the values 0.00–0.30. Please explain how these values were computed and rounded.
- Training protocols, architectures, and hyperparameters for the generative baselines (TABCF, Tabular Diffusion) are not reported; Appendix B describes them only by name and results. Several classical baselines appear poorly tuned (e.g., 5% validity for the genetic algorithm on the linearly separable Iris task), and DiCE is run in its random-search mode.
- The plausibility metric (distance to the nearest training point of any class) favors QIOCE, which explicitly optimizes KDE density; the class-conditional variant defined in Appendix C.2 is not reported.
- Wall-clock runtime is not reported, and classifier query budgets are unmatched (Table 6 shows thousands of calls per instance for QIOCE).
- Evaluation is limited to small, low-dimensional datasets (at most 13 features), without standard recourse benchmarks such as Adult, German Credit, or HELOC. These issues prevent a reliable assessment of whether QIOCE improves on existing methods.
Questions for authors
Clarification requests (answers could change my assessment):
-
Which QIOCE configuration produced the results in Table 1? Table 1 reports 100% validity for all six methods on all seven datasets, whereas Table 5 shows that standard QIOCE ends with 22/50 (Iris) and 29/50 (Wine) valid outputs.
-
How were the Sparsity means and standard deviations in Table 1 computed and rounded? Every mean, although averaged over many instances per seed and three seeds, ends in a zero in the hundredths place (e.g., 9.10 on Diabetes), and some fractional means have a standard deviation of exactly 0.00.
-
What architectures, training hyperparameters, and sampling budgets were used for TABCF and Tabular Diffusion, given training sets as small as ~124 instances (Wine)? How was 100% validity achieved: by rejection sampling, post-hoc filtering, or another mechanism?
Matched Controls, Experimental Clarifications, and Additional Evidence
We thank the reviewer for recognizing QIOCE's originality. We added parameter-matched controls, ten-seed results, and clarified the evaluation protocols.