- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper aims to estimate the modality value of omics data in survival analysis. Here, the authors identify to major challenges: (i) distribution shift between patients where omics data is observed vs unobserved, and (ii) right censoring of survival outcome. For his, the authors argue that current methods use naive comparison of predictions between the groups which leads to biased estimates. From this, the authors derive conditions when the modality gain is actually identifiable and propose a paired increment estimator with IPW and IPCW. They evaluate their method on TCGA datasets against baselines and ablations.
Critical strengths
- The overall problem setting of distribution shift in observed omics data (“acquisition”) and right censoring in survival data for estimating the modality value of omics data seems plausible, and defining conditions for identifiability and using ideas from IPW and IPCW seems in general like an useful approach.
Critical weaknesses
The main problem of this submission is that the paper is very hard to follow and the overall presentation is poor which also makes it hard to judge the soundness of the paper:
- The language uses terms that are unnecessarily complex for the concepts they describe and that are also not defined before using and are used inconsistently throughout the paper. The paper loses itself in details in the theory and experiments section, where however, the motivation of the choices for all these implementation details is incomprehensible or completely missing.
- The overall structure is also not clear. As one general example, the contributions part in the introduction does unstructured cross-referencing to also partially overlapping and not connected and not ordered sections, in the contributions arbitrary results are already stated for where it is not clear what setups and experiments they refer to, etc. This is just one representative example of similar style throughout the paper.
- The same holds for Sec. 3, which tightly compresses setup, objective and theory into one section, but where the motivation and interpretation of the different components is missing or unclear for most of the paragraphs here. Also here, empirical results are already referenced for which the experiment setup is not described (yet) at all. Overall, this makes it additionally challenging to correctly evaluate the soundness of the paper.
- Further, the comparison to related work is rather short, making it hard to judge the contribution of the paper properly.
- The experimental setup in Sec. 5 also does not provide any intuition on the motivation for dataset, modelling, and evaluation choices and reads more like an automatically generated short summary. This makes it hard to judge the value of the proposed experimental setup and the results of Sec. 6 which are then also hard to follow.
General formatting concern: It seems like this paper uses an incorrect citation style for ICLR submissions (i.e., it uses numbered citations instead of the “authors, year” style). It should be checked whether this itself is a major violation which is ground for rejection.
Questions for authors
I do not have any concrete questions whose answers would change my assessment. I think the major issue is the presentation which needs to be fixed first to judge the soundness better.