- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2(+1)
Read review
Paper summary
The paper formulates sequential regulatory genome editing as planning over state-dependent action sets, where each edit can change which subsequent edits satisfy computational targeting constraints. It introduces L2L-GP, which performs gradient ascent on a training-free proxy over engineered action features and projects the resulting vector onto legal candidate edits. Evaluation uses 50 RegEdit tasks with a frozen AlphaGenome predictor as the objective. Comparisons with a No-Ascent control show modest, task-dependent gains from the gradient proposal mechanism.
Critical strengths
The problem formulation captures a relevant constraint in sequential genome editing. Earlier edits can alter guide/PAM compatibility and subsequent targeting opportunities. Explicitly distinguishing fixed and dynamically regenerated candidate sets makes this dependency testable.
Critical weaknesses
First of all, the paper is poorly written, with many important details missing, including the core method, benchmark procedure, and biological rationale. The training-free proxy is not explicitly defined, and the complete 18-dimensional action encoding is not provided. It is therefore unclear how these features are constructed, where they come from, and what justifies their use. Furthermore, Section 5.2 states that “The exact per-task exposure-matching schedule will be specified with the formal receipts.” This is an unresolved placeholder for a procedure that directly supports the paper’s central conclusion, making it difficult to assess the validity and reproducibility of the comparison. Furthermore, the experiments do not sufficiently establish that the proposed method is useful and generalizable. The evaluation covers 50 expression-increase tasks, but their selection criteria and biological diversity are not adequately described. Dynamic regeneration shows no detectable benefit after exposure matching, while gradient ascent provides only a small median improvement over the No-Ascent control. The same AlphaGenome predictor is used for both optimization and evaluation, without independent biological validation or mechanistic analysis. Consequently, it remains unclear whether the reported improvements reflect meaningful biological effects or generalize across diverse sequence contexts.
Questions for authors
- What exactly is the training-free proxy, and how are the 18 action features constructed and justified?
- How were candidate exposure and query budgets matched, and why do the reported budgets differ between experiments?
- How were the 50 tasks selected, and how diverse are their biological contexts?
- Are the gains over No-Ascent statistically reliable, and is their biological relevance supported by independent evidence?
2 comments
Thank you for the detailed response and the revision. The added clarification and the clearer presentation make the paper much easier to follow and reproduce. In this sense, I have raised my score to 2. However, because the scientific contribution and rigor remains limited, I am not able to raise the score further.
Response to Reviewer dwKv: Method, Evaluation Protocol, and Reliability
Thank you for your detailed questions on the method, evaluation protocol, task construction, and reliability of the reported gains. The revision provides explicit proxy, feature, and search specifications and a new same-version ascent ablation.
Q1. Proxy and 18-dimensional action representation
L2L-GP uses an analytic, training-free proxy to guide continuous proposals, which are projected onto currently executable CRISPR edits. Section 4.1 gives the complete proxy and regularized waypoint objective (Eqs. 1–2); Appendix A.2 specifies the 18 action features, sources, normalization, ascent updates, projection, coverage, and tie-breaking.
The coefficients are fixed heuristics for targeting context, efficiency priors, and edit burden, not learned or biologically calibrated effect sizes. Only target missingness from the state vector explicitly enters the proxy; other state dependence arises mainly from the regenerated executable catalog and action features. Projection searches the full current catalog, enforcing targeting and coordinate-replay constraints after each committed edit.
Q2. Exposure matching and query budgets
For the Dynamic–FrozenRoot greedy comparison, the per-task, per-depth schedule is ki,t=min(128,ni,tFR), where ni,tFR is native FrozenRoot's recorded evaluated count. It is determined without using paired terminal outcomes. Both arms use the same candidate-count schedule and selection rule, without padding short pools. This tests root-replay restrictions under FrozenRoot-derived exposure schedules; candidate identities and physical costs may differ.
The greedy comparison has a request ceiling of 384. The separate L2L-GP/No-Ascent comparison uses 1792 per arm, with projection/preview width 128, beam four, and one successor lookahead. Sections 5.2–5.3 and Appendix A.4 distinguish planner requests, predictor-ledger events, and physical calls, including the three 383/384 exported-count discrepancies. Historical comparisons use native caps and are not equal-compute rankings (Tables 1, 7).
Q3. Task selection and biological contexts
Development50 was selected using predefined technical eligibility, prior-exposure exclusion, positive oriented-effect filtering, deterministic locus/component representatives, and chromosome/orientation stratification. Neither AlphaGenome predictions nor effect-size magnitudes determine selection ranking. Thus, selection is not driven by favorable predicted outcomes (§5.1; Appendix A.3).
The frozen cohort covers 50 distinct genes/loci, eight chromosomes, and 26 tissue annotations, spanning multiple genomic and regulatory contexts. The supplement documents selected-task identities and annotations. All evaluated tasks concern expression increase; unseen-task generalization is not established, and complete upstream materialization/input-exposure records are unavailable.
Q4. Reliability of the No-Ascent comparison
Both arms were rerun with the same code, predictor, and search configuration, changing only ascent steps (32 versus zero). Each task uses a recomputed common unedited baseline. The endpoint is a reference-base-pair-weighted predicted RNA-seq signal over the full transcript, with deleted reference bases contributing zero and the original transcript length retained as denominator (§5.3; Appendix A.3).
Across 50 paired tasks, ascent yields 39 wins and 11 losses. The mean paired absolute-change difference is 0.001828 (95% CI [0.0000491, 0.004810]); the median is 0.0001512 ([0.0000425, 0.0003007]). Median paired relative-gain difference is 0.447 percentage points. Both confidence intervals exclude zero. We use 10,000 complete-pair bootstrap resamples (seed 20261117), with percentile endpoints; task-level data and analysis code are provided (§6.3; Appendix A.5).
The positive effect is not restricted to T07, although that task contributes 68.8% of the net paired sum. Excluding T07 as an influence diagnostic leaves 38/49 positive differences and a positive median interval, while the mean interval includes zero. All 50 tasks remain in the primary analysis. The earlier historical No-Ascent comparison is distinct; the same-version ablation is the primary component evidence. Stage-level candidate and branch traces were not retained, so the endpoints do not identify which intermediate changes carry the effect.
These findings support a predicted-utility contribution from ascent in this in silico planner, not independently verified biological efficacy or cross-predictor generalization (§7).
Correction of turnover interpretation: The original 40/50 count concerns tasks selecting root-absent exact IDs, not necessarily new operations. Of 68 selected root-absent records, 36 retain a root replay counterpart, while 32 lack a root replay key; those 32 occur in 24/50 tasks (§6.1; Appendix A.1).