- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SENTRY-BD, a bilevel optimization framework for selecting compact gene panels for cross-context perturbation response recovery. The method combines differentiable gene selection, an analytically refitted ridge predictor, and a signed-response loss. Experiments on CD4 T-cell and K562-to-RPE1 datasets report improvements over existing gene-selection methods, including PERSIST and residual selection. Additional theoretical derivations and ablation studies are provided to justify the proposed framework.
Critical strengths
The paper addresses a relevant problem in efficient perturbation measurement. Optimizing gene selection according to downstream prediction performance is a reasonable direction. The use of a common decoder, multiple baselines, and component ablations provides a useful basis for evaluating the proposed method.
Critical weaknesses
Weakness 1: The central methodological contributions are not supported by the experimental evidence, raising serious concerns about novelty and necessity.
a. The proposed bilevel differentiation provides negligible benefits. Table 2 shows that stopping gradients through the inner-model refitting achieves an MSE of 0.07824, nearly identical to the full method's 0.07821. Removing the signed-response loss similarly yields 0.07823. These results directly question whether the paper's emphasized technical components contribute meaningfully to performance.
b. Limited theoretical novelty. The proposed exact gradient and finite-change identities primarily follow standard differentiation and algebraic properties of ridge regression. The paper neither establishes meaningful theoretical guarantees for the resulting discrete gene panels nor demonstrates an empirical advantage attributable to differentiating through the inner optimization.
The primary methodological contribution appears insufficiently novel and empirically unjustified, substantially weakening the paper's significance.
Weakness 2: The empirical improvements are marginal, inconsistent across evaluation metrics, and insufficient to establish superiority over strong baselines.
a. Minimal improvement over competitive methods. On CD4, SENTRY-BD reduces MSE by only 0.66% relative to the stronger 64D residual-selection baseline. On K562-to-RPE1, the improvement is approximately 0.16% and is not statistically significant. Moreover, the proposed method performs worse than residual selection on standardized MSE in both tasks, while simple variance selection achieves better signed top-20 overlap.
b. Insufficiently controlled comparisons. The headline comparison against PERSIST is potentially misleading because PERSIST uses a restricted 1,000-gene candidate pool, whereas SENTRY-BD searches the full gene space. The paper's own ablation shows that restricting SENTRY-BD to the same candidate pool noticeably reduces its advantage. Therefore, the reported improvements cannot be attributed solely to the proposed optimization strategy.
The empirical evidence fails to demonstrate a substantial or consistent advantage over simpler alternatives, making the additional methodological complexity difficult to justify.
Questions for authors
Q1. Given that stopping gradients through the inner optimization yields nearly identical performance, what concrete evidence supports the necessity of the proposed bilevel differentiation rather than simpler supervised gene-selection approaches?
Q2. How can the authors establish that the reported improvements originate from the proposed optimization method rather than differences in candidate-pool size or baseline configurations? Can all methods be compared under strictly matched candidate spaces and model settings?
Q3. How do the authors justify the significance of the marginal improvements over strong residual-selection baselines, particularly when the gains are statistically insignificant on one task and the method underperforms on several alternative metrics? Do these conclusions remain consistent across different decoder configurations?
3 comments
Thank you for the additional experiments. The matched candidate-pool comparisons and the fresh test set address some of my concerns, but the central methodological contribution remains weakly supported. Appendix Table 9 shows only a 0.09% improvement over the stop-gradient control, with a confidence interval that includes zero, while removing the signed-response loss has essentially no effect. The exact gradient helps only in some Replogle settings and performs worse at two smaller budgets on the fresh CD4 test. I therefore remain unconvinced that the paper establishes the necessity, consistency, or practical value of its main technical components.
Beyond the technical issues, I have serious concerns about the authors’ research attitude and the overall quality of the submission. The original manuscript strongly appeared to be AI-generated throughout: its organization was highly careless, its presentation was awkward and difficult to read, and it lacked the level of human verification and academic rigor expected of an ICLR submission. After revision, the methods, experiments, and narrative changed substantially, yet these changes were not clearly marked. In my view, this indicates that the original submission was not a mature piece of work and was instead extensively reconstructed during the review process. I consider this highly unprofessional.
More seriously, even the abstract spacing in the revised manuscript does not follow the ICLR template. This is not merely a formatting detail; it further reflects a lack of care toward the submission requirements and basic manuscript quality control. I do not believe a submission in this state should proceed through the normal review process.
I also do not understand the basis for the scores of 3 given by other reviewers. I strongly encourage them not to rely on AI-generated summaries or judgments, but to personally read and compare the original and revised manuscripts. The maturity, writing quality, and revision practices demonstrated here do not meet the standard I expect from an ICLR paper.
Considering the paper, the additional evidence, and the concerns above, I retain my original score of 1 as my final rating. I strongly recommend that the AC personally examine every version of the manuscript and its revision history before making a decision.
Response to Reviewer EUdD
Thank you for reading each version closely and for the specific points. Our responses follow.
Technical contribution. The paper’s main claim is that a panel should be chosen by the held-out error of the predictor refitted on it. The full and stop-gradient updates optimize the same objective and differ by one second-order term. The original submission already reported that this term has a small effect (§5.4). The evidence for the formulation is the comparison with the supervised starting ranking. On the 1,606 unused perturbations, learning the panel through the refitted predictor reduced error by 2.56% [2.33, 2.79], and scoring it on separate query perturbations gave a further 0.37% [0.24, 0.49]. The sparse selector added in the revision does not use the signed-response term.
Checks after the revision. After posting the revision, we checked the gradient code against explicit ridge refits and recomputed the reported comparisons from the stored per-perturbation results. The code for the sparse stop-gradient control left out the contribution of the held-out row. We fixed this. Table 3A now reports the corrected comparison: at 128 genes, the full and stopped updates are close on both tasks. The three affected rows of Table 9 keep their recorded values and are marked in Appendix F. None of the five primary comparisons uses this control, so they are unchanged.
We also found that the previous revised PDF had been compiled with a modified style file, which changed the spacing of the abstract, captions and lists. The PDF now posted uses the unmodified ICLR 2027 style file and includes both corrections.
Changes in the revision. The submitted method is unchanged and appears as “SENTRY-BD (submitted)” in every table, including the new test on 1,606 perturbations. To address the questions about decoder dependence and panel stability, the revision adds a leave-one-out selector and a three-stream predictor, reported in separate rows. We have sent the Area Chair a section-by-section list of the changes.
Verification. The AI-use statement describes how AI tools were used and what the authors checked. The supplement contains the locked protocol, the per-perturbation results, and verify_results.py, which recomputes the primary and secondary comparisons on the new cohort as well as the shared-pool comparisons.
Response to Reviewer EUdD
Thank you for the detailed review. We begin by explaining what two of the controls measure, since this affects several of the points raised. We also report a test on 1,606 CD4 perturbations that had not been used before (general response, Appendix F).
Q1 (Weakness 1a). Evidence for the bilevel formulation. The stop-gradient variant in Table 2 is itself a bilevel method. At every step it solves the inner ridge problem and evaluates the refitted predictor on separate query perturbations; it removes only the second-order term of the derivative (Appendix A.2). Table 2 therefore compares two ways of differentiating the same bilevel objective.
The comparison with simpler supervised selection is the fixed-initialization control, which starts from a supervised marginal ranking:
Weakness 1b. Role of the theory. Proposition 1 gives the effect of refitting in closed form: each gene's value is its query innovation times its endpoint coupling. This form makes exact leave-one-out training over all perturbations possible in seconds with G ≈ 10^4 genes (§4.2), and this is what allows the method to search the full gene set.
Q2 (Weakness 2b). Same candidate pool. Table 3B runs this comparison directly. Inside PERSIST's own 1,000-gene pool, with the same decoder and budget, SENTRY-BD outperforms PERSIST-64D:
The gain over PERSIST therefore holds with matched candidates. Given all genes, PERSIST becomes slightly worse (0.07981) while SENTRY-BD improves. All other baselines already use the full gene set, the same decoder and the same budget.
Q3 (Weakness 2a). Significance and consistency.