- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a framework for jointly analyzing multi-modal single-cell data, specifically focus on data sets containing three types of data: RNA-seq, ATAC-seq, and surface protein data. This is the first paper to do this kind of analysis on this particular set of three data types. Furthermore, the proposed method uses generative techniques, including that diffusion and flow matching, that have previously only been applied to RNA-seq but not multi-omics data. The paper shows empirically that the proposed model, called scMOD, outperforms state-of-the-art methods in a variety of settings.
Critical strengths
Empirically, the results are strong, and the experiments appear to be well done. I am convinced that the method delivers better performance on the stated tasks than the state-of-the-art methods that you compared against. The ablations also support this conclusion.
The paper does a very nice job of clearly laying out the proposed modeling framework, providing general background as well as the details of the proposed model. I appreciated the attention to detail in the appendix.
Critical weaknesses
I don't think this paper is written to be accessible to an ICLR audience. The ML parts are fine, but I don't think you have done a good job of explaining what the data is or motivating why these problems are interesting or important. For example, I work in this field but was not familiar with the cell surface marker data that you are working with here. A typical ICLR reader will not even know much about RNA-seq or ATAC-seq, much less ADT. (Indeed, what does "ADT" even stand for?) A background section should have been provided, or the introduction should have been expanded, to explain what this data is. Furthermore, I'm not convinced that the problems you are trying to solve are important. Yes, translating from one data type to another is potentially useful, but I can't imagine a scenario in which unconditional generation of multi-omic data is a worthwhile thing to do. Again, providing background and motivation would have helped here.
The other main weakness is that you haven't really separated out the two potential avenues of novelty here. One avenue is your particular modeling paradigm, and the other is its application to this particular trimodality of data types. If you want to argue that the paradigm is generally useful, then applying it to some other data types (e.g., NEAT-seq, scNMT-seq, or scTrio-seq2) would be more convincing.
Questions for authors
I have no questions, other than the ones implied above:
Why is unconditional generation of multi-omics data interesting or useful?
How well does this approach work with other combinations of data types?
4 comments
Response to Reviewer 3iDA (2/2)
Weakness 2: "Furthermore, I'm not convinced that the problems you are trying to solve are important. Yes, translating from one data type to another is potentially useful, but I can't imagine a scenario in which unconditional generation of multi-omic data is a worthwhile thing to do. Again, providing background and motivation would have helped here."
Question 2: "Why is unconditional generation of multi-omics data interesting or useful?"
Response.
Thank you for this important question. Our motivation comes from the broader goal of building virtual cells. Fully paired RNA–ATAC–ADT measurements are expensive and relatively scarce, while many studies measure only one or two of these molecular layers. Completion therefore has an immediate use: for example, inferring a cell’s surface proteins when only its RNA has been measured. Methods such as BABEL demonstrate the value of recovering such unmeasured molecular information.
A virtual-cell model should also capture the diversity of states that real cells can occupy. Even cells of the same type differ in which genes are active and how much of each protein they produce. Modeling this variation, together with the relationships between molecular layers, is a foundation for simulating cellular states. Unconditional generation directly tests this ability: the model must produce realistic, varied cells whose RNA, chromatin, and protein profiles fit together, without being given a measured profile to guide each sample. This provides a basis for future conditional simulations of how cellular states vary with cell type, disease, or perturbation, as envisioned in virtual-cell modeling.
This motivation is shared by established single-cell generation work. scLDM [1] explicitly studies unconditional RNA generation, while scDiffusion demonstrates generation of specified cell types and developmental trajectories. Generation also has practical downstream value: CFGen shows that adding generated examples helps models recognize rare cell types. Our work scMOD extends this direction to a richer description of the cell, jointly modeling gene expression, chromatin accessibility, and surface proteins in the same framework used for completion. Our results show both realistic molecular profiles (Table R1) and stronger agreement in the cell identity inferred from different modalities (Table R5), supporting this step toward multimodal virtual cells. All the references can be found in Section 2.
References:
[1] Giovanni Palla, Sudarshan Babu, Payam Dibaeinia, James D. Pearce, Donghui Li, Aly A. Khan, Theofanis Karaletsos, and Jakub M. Tomczak. Scalable Single-Cell Gene Expression Generation with Latent Diffusion Models, 2026.
Weakness 3: "The other main weakness is that you haven't really separated out the two potential avenues of novelty here. One avenue is your particular modeling paradigm, and the other is its application to this particular trimodality of data types. If you want to argue that the paradigm is generally useful, then applying it to some other data types (e.g., NEAT-seq, scNMT-seq, or scTrio-seq2) would be more convincing."
Question 3: "How well does this approach work with other combinations of data types?"
Response.
Thank you for this insightful suggestion. Our modeling formulation separates assay-specific representations from shared multimodal generation. Modality-specific codecs map heterogeneous measurements into latent blocks, and a shared block-causal flow model learns how to generate those blocks from the available modalities. Randomized modality ordering enables the same model to handle different observed and target sets. This modular design also provides a route to other assay combinations: a new measurement type can be represented by a suitable codec while retaining the block-causal training and sampling formulation.
Your suggestions of NEAT-seq, scNMT-seq, and scTrio-seq2 are particularly interesting extensions of this design. We appreciate these concrete suggestions, which would broaden the biological scope of scMOD and provide a valuable test of its formulation beyond the current modality combination. At present, we do not have suitable datasets for these additional assays with comparable cell numbers and the paired measurements required by our evaluation protocol. Obtaining appropriate datasets and adapting the modality-specific codecs is therefore an important direction for future work.
I'm not really convinced here. The addition of a paragraph describing the dataset will help ICLR readers, but the paper really needs to be substantially revised to make it accessible. As for unconditional generation of multi-omics data, the only concrete example you gave is imputing a missing modality, but of course, that's not unconditional. I agree that imputing a missing data type is useful, but imputing all three at once unconditionally seems like an interesting but not particularly useful exercise (despite the fact that others have published papers doing this). The third point wasn't really addressed, other than to say you will do it in the future.
2nd Response to Reviewer 3iDA
"I'm not really convinced here. The addition of a paragraph describing the dataset will help ICLR readers, but the paper really needs to be substantially revised to make it accessible. As for unconditional generation of multi-omics data, the only concrete example you gave is imputing a missing modality, but of course, that's not unconditional. I agree that imputing a missing data type is useful, but imputing all three at once unconditionally seems like an interesting but not particularly useful exercise (despite the fact that others have published papers doing this). The third point wasn't really addressed, other than to say you will do it in the future."
Response.
We thank the reviewer for clarifying the remaining concerns. We appreciate the opportunity to further explain the biological motivation, the role of unconditional generation, and the scope of our evaluation.
Improved readability towards general audience. We carefully revised the opening of the Introduction to explain what RNA, ATAC, and ADT measure before introducing the modeling tasks. It explains why we model them together using the example of cells with similar RNA profiles but different DNA accessibility or surface protein levels. Section 2.1 now describes the three count vectors and explains that a paired sample links measurements from the same cell.
Motivation for unconditional generation. Unconditional generation tests how well a model captures the data distribution without an observed input. For example, in image diffusion, DDPM [1] uses FID to evaluate unconditional CIFAR-10 samples, indicating that unconditional generation can serve as a widely recognized metric for measuring a method’s effectiveness.
We apply the same idea to joint RNA, ATAC, and ADT profiles. Instead of FID, which is used in image generation, we follow prior work and use metrics such as W2, MMD2, and 1-NN, which are also common in this field. An unconditional scMOD sample contains three profiles, so we also test whether they resemble measurements taken together in real cells. On TEA-seq, joint generation gives a lower joint MMD$^2$ against real paired cells than independent generation with profiles re-paired within the same predicted cell type (Table R6).
References:
[1] Ho, J., Jain, A., & Abbeel, P. (2020). Denoising diffusion probabilistic models. Advances in neural information processing systems, 33, 6840-6851.
Generality across assay combinations. We do appreciate the reviewer highlighting some useful data and potential applications in other subfields. These assays provide measurements paired within cells, but the measurements differ from those in our benchmarks. NEAT-seq targets nuclear proteins, while scNMT-seq and scTrio-seq2 profile DNA methylation, and scTrio-seq2 also reports detailed alterations. Testing these combinations would require preparing matched profiles, adapting new codecs, evaluating the model on held-out paired cells, and determining which metrics capture performance in these new settings. Our work can theoretically be reused in such new settings, but learning and evaluating a joint distribution on such new tasks still requires suitable measurements paired within cells. In the final phase of the rebuttal, we acknowledge that these settings can only be left to future work and appreciate your understanding.
Response to Reviewer 3iDA (1/2)
Thank you for highlighting the need to better explain the biological motivation and the scope of our claims. In response, we have revised the Introduction and Background to make the RNA–ATAC–ADT setting more accessible to a general ICLR audience and to clarify the motivation for multimodal completion and generation.
Response.
Thank you for this suggestion. We have added a dedicated background subsection, Single-cell multi-omics measurements (Section 2.1), that introduces the three modalities and the two benchmark assays in terms accessible to an ML audience.
The three modalities provide complementary views of the same cell. RNA sequencing (RNA-seq) [1] measures gene expression through transcript counts. The assay for transposase-accessible chromatin using sequencing (ATAC-seq) [2] measures which genomic regions are accessible, providing a view of regulatory potential. Antibody-derived tags (ADTs) [3] use DNA-barcoded antibodies to measure selected cell-surface proteins, which help characterize cell identity and phenotype. For the model, each modality is a count vector over genes, genomic regions, or antibody targets.
TEA-seq and DOGMA-seq measure all three profiles in the same cell. They therefore allow us to test both whether scMOD recovers an unmeasured profile and whether generated profiles describe a coherent cell. The revised Introduction now connects this biological setting directly to the completion and generation tasks.
References: