- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes TopoGAT, which leverages the parallelism topology and normal spatiotemporal patterns of distributed training to capture relationships between nodes. It further introduces a two-stage error calibration mechanism to mitigate common anomalies caused by synchronization propagation, enabling root-cause localization without requiring fault labels. Overall, the paper is well motivated, and the experimental evaluation is fairly comprehensive and convincing.
Critical strengths
-
I think the paper is motivated by a very good and important problem. One particularly interesting observation is that, in distributed training, the actual faulty node may not have the highest anomaly score, as synchronization delays can also slow down other nodes. I find this insight particularly compelling.
-
The experimental evaluation is thorough and provides convincing evidence to support the paper’s main claims.
-
The paper is well written and well organized, making the motivation, proposed method, and experimental results easy to follow.
Critical weaknesses
-
On D1, TopoGAT performs worse than VAE despite its topology-aware design, while generalizing better to unseen datasets. It would be helpful to clarify the reason for this difference.
-
The learned attention weights are nearly uniform, and replacing them with uniform weights has little impact on performance. This raises questions about the necessity of GAT over simpler aggregation methods. Could the authors better isolate the contribution of the graph structure compared with strong non-graph baselines and further explain the model’s cross-topology generalization?
-
In Table 23, localization performance improves as more ranks are missing (from 4 to 8 to 16 ranks). This unexpected trend warrants further investigation, ideally with repeated trials to rule out sampling variability.
-
In Equation (5), the term “neighbor mean” is not clearly defined. Please specify which neighbors are included in the aggregation.
Questions for authors
See Weaknesses.