- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents GIDER, a novel method for modelling the effect of CRISPR-Cas9 perturbations on single-cell gene expression distributions. The method utilises information from the pairing of the sgRNA to target and off target sites in addition to using information from the DNA sites themselves. Across a few benchmarks, they demonstrate their method outperforms others in the field in addition to a few simple baselines and ablations,
Critical strengths
The method leverages novel information that other approaches lack, explicitly incorporating sgRNA-specific targeting relationships and potential off-target sites to guide the integration of genomic context.
Critical weaknesses
The empirical validation of GIDER is insufficient to conclude it outperforms other methods or simple baselines. Of the two benchmarks reported, GIDER only consistently outperforms other methods on one. Additionally, the benchmarks lack Pearson delta metrics and simple mean-predictor baselines, which Systema (Viñas Torné et al., 2025) shows are important for assessing whether models capture perturbation-specific effects. Also, no error bars or cross validation is performed, so the significance of the improvements cannot be evaluated.
The method is very complex, with some of the design decisions lacking ablations or clear justifications. The model introduces numerous heuristic design choices, including two-stage attention, shared site weights, graph-based gene grouping, and a complex state-conditioned generator. The ablations performed do not isolate these components and so the reason behind their use remains unclear.
Questions for authors
What motivates the construction and reuse of the gene graph for both message passing and fixed gene grouping? Have the authors tested the effect of sgRNA-site information in a simple baseline?
Can the authors report results across multiple random seeds with error bars or confidence intervals, and extend the architectural ablations to Frangieh to demonstrate that the improvements are robust?