- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper examines settings in which missing features are concentrated in connected regions of a graph. It introduces a controlled masking procedure and proposes PEMix, which conditions a probabilistic feature model on structural encodings before message passing. Experiments with both synthetic and naturally occurring missingness show performance improvements in several settings.
Critical strengths
1.The paper addresses a relevant issue in the evaluation of methods for handling missing features and clearly explains why clustered missingness can pose challenges for feature propagation. 2.The matched ablation study provides convincing evidence for the benefits of structural conditioning on TADPOLE.
Critical weaknesses
1.The performance gains vary across datasets, and it remains unclear which properties of the graph or missingness pattern influence the effectiveness of PEMix. 2.The proposed masking procedure captures a relatively specific pattern of missingness, leaving its coverage of other graph-structured missingness patterns unclear.
Questions for authors
1.Does PEMix remain effective under other forms of graph-structured missingness? 2.What factors account for the variation in performance across datasets, particularly in cases where propagation-based methods perform better?
4 comments
Thank you for the detailed response and the additional experiments. The Ising-model results provide further evidence on PEMix under a different graph-structured missingness pattern, while the analysis of PE predictability offers a possible explanation for the variation across datasets. I appreciate the clearer discussion of the method’s assumptions and the conditions under which it may be most useful.
Thank you for your follow-up and for acknowledging our additional analyses. We are glad that the Ising-model experiments and the PE predictability analysis helped clarify how PEMix behaves under different graph-structured missingness patterns, and under which conditions it is most effective.
We sincerely appreciate your review. Your comments directly led to these additions, and we believe they have made the paper more complete, both in the range of missingness mechanisms it covers and in how clearly it states the method’s assumptions. If you feel the paper has been strengthened as a result, we would be grateful if you would consider taking this into account in your final evaluation.
Thank you again for your time and engagement during the discussion.
Dear Reviewer,,
We noticed that the rating was recently changed from 3 to 2. Given your latest comment, which indicated that our additional experiments and analyses addressed your questions, we wondered whether this change might have been unintentional. Could you kindly confirm whether the updated rating reflects your intended assessment?
Thank you again for your time and engagement.
Response to W1–W2 and Q1–Q2.
Thank you for your detailed review and your valuable time. Below, we address your concerns.
W2/Q1: Effectiveness with other structural missingness
RT captures realistic scenarios, such as localized failures in sensor or communication networks. However, we agree that other realistic graph-dependent missingness patterns are not covered by RT. We have now included in the paper another realistic graph-structured missingness scenario, based on the Ising model [1]. The Ising model uses two parameters: the first controls how strongly the same feature tends to be missing at neighboring nodes, while the second controls how strongly different features tend to be missing together within a node. Unlike RT, there is no shared source node, and multiple missing regions can form. We verified on TADPOLE that Ising masks exhibit different spatial correlations compared with RT (Table 52). Importantly, PEMix does not assume RT or any specific missingness geometry. Results under the new Ising mechanism, evaluated at the same missingness rates as RT. Consistently with the RT results, PEMix achieves the best AUC under the Ising setting on five of the six datasets, across classification and forecasting tasks (Table 53). A detailed description of the Ising mechanism and further experimental details are provided in Appendix G.
[1] Murphy, K. P. (2012). Machine Learning: A Probabilistic Perspective. MIT Press.
W1/Q2: Factors behind the variation across datasets.
We investigate the factors behind dataset-dependent performance in Appendix H. PEMix relies on the assumption that node features and structural position are dependent. In that case, PE provides useful information about node features and we expect larger gains when this dependence is stronger. To quantify this relationship, we train an MLP to predict node features from PE, measuring predictability S as the relative reduction in squared prediction error compared to predicting the training mean. As shown in Figure 6, higher predictability is associated with larger PEMix gains: Electric (S≈0.35), TADPOLE (S≈0.17), and Tolokers (S≈0.11) achieve improvements of 10.9%, 10.4%, and 4.9%, respectively, over the strongest competitors under RT. Conversely, EngRAD and GraphMSO have near-zero predictability, explaining why structural conditioning provides little additional benefit. This is due to the particular nature of these two datasets, originally designed for spatio-temporal forecasting, where the features are seasonal time series. The graph topology describes which time series are related, but there is no static information that distinguishes and characterizes the nodes, nor do these have a specific role in the graph. The graph, thus, provides only relational information, which is already well captured by a propagation-based method. The limited or negative gains of PEMix on these datasets are therefore consistent with its underlying assumption. These results suggest that the strength of the relationship between structural position and node features is an important factor explaining performance variation across datasets. PEMix is expected to provide larger benefits when this relationship is strong, particularly under graph-structured missingness.
We thank the reviewer again for their constructive feedback, which helped us strengthen the experimental evaluation and clarify the conditions under which PEMix is most effective. Please let us know if our responses address your concerns or if further clarification would be helpful.