- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies histopathological image generation conditioned on single-cell RNA expression, focusing on the problem that a model may generate visually realistic images while underutilizing its RNA input. Building on GeneFlow's conditional rectified-flow framework, the authors introduce gene-level token encoding, global and spatial conditioning pathways, and a ranking objective that compares velocity-prediction errors under matched and shuffled RNA conditions. They also enable RNA-guided image editing through image inversion and condition replacement. Experiments use three Xenium skin-melanoma datasets with spatially guarded splits that prevent overlap between training and validation image crops. The authors evaluate image quality, RNA consistency, and controllability using shared-noise generation, within-cell-type RNA swaps, and magnitude-matched gene perturbations. The results support more effective use of RNA conditions by GeneFlowV2 than by GeneFlow.
Critical strengths
The paper identifies a clear problem and aligns its evaluation with its central claim. The authors directly test whether the generator uses sample-specific RNA information by varying RNA while holding the initial noise fixed. They also audit image-crop overlap under the original random-split protocol and retrain the compared models on the same spatially guarded partitions. These choices strengthen the credibility of the controllability comparisons.
Critical weaknesses
The main quantitative comparisons focus on GeneFlow, without evaluating a GeneFlow baseline augmented with ranking supervision under the same training protocol. Section 4.5 explicitly states that the "without RNA ranking" variant removes ranking from both training and checkpoint selection; its performance degradation therefore cannot be attributed solely to the training loss. This limits the evidence for the separate contributions of the ranking objective, model-selection strategy, and redesigned conditioning architecture. The gains over simpler conditional-modeling alternatives are consequently not yet fully established.
Questions for authors
- Were the samples used for the results in Tables 1-4 also used for checkpoint selection and early stopping under Eq. (20)? If a separate test set was used, please clarify its sample counts and spatial separation. If not, could the main results be evaluated on a spatial region that was not used for model selection?
- Could you isolate the effects of ranking during training and checkpoint selection by comparing configurations with and without each component, while holding the other settings fixed? This would materially affect my assessment of the ranking objective's independent contribution.
- Could you evaluate GeneFlow augmented with ranking supervision and report the training budgets and checkpoint-selection procedures for both models? This comparison would help determine whether gene-level encoding and dual-path conditioning provide additional benefits beyond ranking supervision.
3 comments
Authors' rebuttal, Part 2
Q3. GeneFlow with ranking supervision and training-budget comparison.
We augmented the GeneFlow with the same RNA-ranking loss used in GeneFlowV2 (λ_rank = 0.5), without introducing gene-level encoding or dual-path conditioning. Following the same C1 split and 50-epoch training protocol described above, checkpoints were selected exclusively on the validation set using either Flow or Eq. (20), with identical selection criteria applied to both architectures. Results are reported in the newly added Table 6, with complete results and training budgets in Appendix Table 25.
| Model | Ranking loss | Selection | GPU-h/epoch | UNI2-h FID ↓ | UNI2-h cosine ↑ | MRR@32 ↑ | Gene Pearson ↑ |
|---|---|---|---|---|---|---|---|
| GeneFlow | × | Flow | 1.0 | 97.05 | 0.440 | 0.125 | −0.001 |
| GeneFlow | ✓ | Flow | 1.8 | 51.77 | 0.548 | 0.266 | 0.182 |
| GeneFlow | ✓ | Eq. (20) | 1.8 | 70.01 | 0.516 | 0.231 | 0.138 |
| GeneFlowV2 | ✓ | Flow | 3.2 | 51.70 | 0.552 | 0.302 | 0.229 |
| GeneFlowV2 | ✓ | Eq. (20) | 3.2 | 48.62 | 0.554 | 0.303 | 0.227 |
Ranking supervision improves the GeneFlow. Under identical Flow-only checkpoint selection, adding the ranking loss increases GeneFlow's MRR@32 from 0.125 to 0.266 and Gene Pearson from −0.001 to 0.182, while reducing UNI2-h FID from 97.05 to 51.77. This demonstrates that ranking supervision is effective even without our redesigned conditioning architecture.
GeneFlowV2 provides additional gains beyond ranking supervision. Under the same ranking loss and Flow-only checkpoint selection, GeneFlowV2 outperforms GeneFlow+ranking in MRR@32 (0.302 vs. 0.266) and Gene Pearson (0.229 vs. 0.182), with comparable image fidelity (UNI2-h FID: 51.70 vs. 51.77). Under the same ranking-aware selection criterion, GeneFlowV2 further achieves better UNI2-h FID (48.62 vs. 70.01), MRR@32 (0.303 vs. 0.231), and Gene Pearson (0.227 vs. 0.138).
Performance–compute trade-off. With ranking supervision, GeneFlowV2 requires approximately 3.2 H100 GPU-hours per epoch, compared with 1.8 for GeneFlow. Despite the additional cost, GeneFlowV2 achieves stronger RNA-conditional fidelity with improved image quality under matched checkpoint-selection criteria.
These comparisons demonstrate that ranking supervision substantially improves the original GeneFlow, while GeneFlowV2's gene-level encoding and dual-path conditioning provide additional benefits beyond the shared ranking objective.
Thank you for the detailed response and additional experiments. I appreciate the authors' efforts to address my concerns, particularly through the independent test-set evaluation, controlled ablation studies, and the comparison with GeneFlow augmented by ranking supervision. These results help clarify the contributions of the proposed components and strengthen the experimental evidence. However, I believe some concerns regarding the extent of the improvements beyond the ranking-augmented baseline remain. Overall, my assessment of the paper remains unchanged, and I will maintain my original score.
Authors' rebuttal, Part 1
We sincerely thank the reviewer for the thoughtful and constructive feedback. Changes in the revised PDF are marked in blue.
Weakness: We have addressed these concerns through a controlled 2×2 ablation separating ranking loss from checkpoint selection, together with a GeneFlow+ranking baseline under matched training and selection protocols. The results confirm the independent contribution of training-time ranking supervision and demonstrate that GeneFlowV2's advantages are not solely attributable to ranking supervision, but also benefit from gene-level encoding and dual-path conditioning (see Q2–Q3; newly added Table 6 and Appendix Table 25).
Q1. Independent test evaluation and checkpoint selection.
In the original submission, Eq. (20) was computed on the reported validation region, which was used for both checkpoint selection and evaluation. We have therefore conducted additional evaluations on strictly independent test set, confirming that the main improvements persist.
Key results are summarized below. Results for the independent C1 test are summarized in the newly added Table 6, with complete results in Appendix Table 25, while TENX125 zero-shot results are reported in the updated Table 1.
On the independent C1 test, GeneFlowV2 reduces UNI2-h FID from 97.05 to 48.62, improves UNI2-h cosine from 0.440 to 0.554, and increases MRR@32 from 0.125 to 0.303. These improvements also persist on the unseen patient, where UNI2-h FID decreases from 166.23 to 92.55, alongside improvements in RNA consistency.
These results confirm that GeneFlowV2's improvements in image quality and RNA consistency persist on an independent test set excluded from checkpoint selection and extend zero-shot to an unseen patient.
Q2. Isolating ranking loss from checkpoint selection.
We conducted a controlled 2×2 ablation to independently evaluate the contributions of the RNA-ranking training loss and ranking-based checkpoint selection. On C1, we crossed the ranking loss (λ_rank ∈ {0, 0.5}) with two checkpoint-selection criteria: the flow-matching loss alone (Flow) and the ranking-aware criterion (Eq. (20)), while keeping all other settings fixed. Training was conducted without early stopping, and checkpoints were selected exclusively on the validation set. Results on the independent test set (20,049 cells) are summarized below (newly added Table 6; complete results in Appendix Table 25).).
Independent contribution of ranking supervision. Under identical Flow-only checkpoint selection, adding the ranking loss increases MRR@32 from 0.146 to 0.302 and Gene Pearson from 0.036 to 0.229, while reducing UNI2-h FID from 65.55 to 51.70. The improvements also persist under identical Eq. (20) selection (cFID: 67.79 → 48.62; Gene Pearson: 0.028 → 0.227). These results demonstrate the independent contribution of training-time ranking supervision.
Additional contribution of ranking-aware selection. With ranking supervision fixed, switching from Flow to Eq. (20) further reduces UNI2-h FID from 51.70 to 48.62 and improves UNI2-h cosine from 0.552 to 0.554, while maintaining comparable RNA consistency (MRR@32: 0.302 vs. 0.303; Gene Pearson: 0.229 vs. 0.227).
Together, these controlled experiments establish that RNA-ranking training loss independently drives substantial improvements in conditional fidelity, while ranking-aware checkpoint selection provides additional benefits in selecting a model with stronger image quality and comparable RNA consistency.