- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Physical degradation measurements differ between systems in terms of channel semantics, physical units, sampling cadence and operating context. For bearings it's vibration, for batteries electrochemical cycling and for turbofans multivariate flight histories. Therefore, industrial prognostics is typically developed per-system, with models that learn system-specific degradation patterns.
While there are transfer learning techniques that are used to adapt knowledge across operating conditions or related domains, they do not investigate if degradation knowledge can be learned jointly across different semantically disjoint physical systems.
The authors introduce CORD, which keeps observation type specific interfaces but shares a degradation backbone across systems. The type-specific interface is split into a global stem that maps each channel across the full sequence length to a global token and a local stem that maps each window-channel pair to a local token. both are pooled across channels and passed to the shared encoder. The shared encoder alternates with a type-specific adapter. The final output projection is shared as well.
It is trained self-supervised with two objectives, Intra-Observation Structure Modeling (ISM), which comes down to masked reconstruction of the local tokens utilizing type-specific decoder and Inter-Observation Dynamics Modeling (IDM), which forecasts the next observation embedding given the past 6 observation embeddings. Different prediction heads utilize the resulting representation on different RUL task.
They test transfer in two stages. Level 1 tests a representation that was pretrained on all available systems on a holdout of one of those systems. Level 2 tests a representation which was pretrained completely without the target system and introduces it only during downstream adaptation. The task they solve is remaining useful lifetime estimation, mapping a (multivariate) time series of the respective system to a scalar RUL value. They test both, probing the frozen representation and full fine-tuning. The evaluations show that CORD is better than the selected baselines and that the pretraining is especially beneficial in the low (labeled) data regime.
The idea to train a RUL estimator jointly on diverse domains to improve its performance is compelling and the results look strong. The authors have properly seeded the experiments, tested probing and full fine-tuning, and have performed interesting ablations like scaling the available labeled data. The paper is very dense and notation-heavy. I think overhauling the notations and aligning the figures with it could greatly improve the overall state of the manuscript. Especially, consistent notation of the tensor shapes in Figure 1 and more details on the observation projection and loss calculation could help to improve clarity. The baselines seem not to be related to prior work that has performed RUL estimation on the used datasets and an assessment of statistical significance is missing. The code is not published. If my questions are adressed properly, I am willing to increase my score to weak acceptance.
Critical strengths
- The improvement looks good and the idea is interesting
- The evaluation across label budget, scratch, single domain and multi-domain for each system is extensive
Critical weaknesses
- Clarity & Notations (see summary & questions)
- Justification of baselines (see questions)
minor:
- I think contribution 2 and 3 could be combined
Questions for authors
- Could you clarify the computational graph? Especially, the part about the observation projection seems to miss an in-detail explanation in the paper. What is the global-state and valid-local mean in Figure 1? Could you additionally clarify the loss calculations by including the model in formula 2 and 3? I'd like to better understand that.
- Is the improvement shown in table 3 statistically significant? A rank-based evaluation would be interesting.
- How where the baselines selected? I guess there is literature available that trains RUL estimators on the respective datasets?
- Why have you decided to use TCN instead of ModernTCN?
- Have you ablated the training of the task specific heads without the backbone on the RUL task?
4 comments
Response to Reviewer MkWP: Additional Stage-wise Analysis
As an additional update, we have included a stage-wise RMSE analysis in Appendix E.4 of the revised manuscript, comparing CORD with existing baselines across three physical systems and different label budgets to provide further insights into prediction performance throughout the degradation process.
Thank you for the revision, which addresses all my points and makes both the improvements and the limitations much clearer, so I am raising my score to 3.
Thank You for Your Feedback and Reassessment
Dear Reviewer,
Thank you for taking the time to review our revised manuscript and responses. We sincerely appreciate your constructive feedback, your recognition of the improvements, and your willingness to reconsider your assessment.
Your comments have been valuable in helping us improve the clarity and quality of our work.
Thank you again for your time and consideration.
Response to Reviewer MkwP: Methodological Clarifications and Extended Evaluation
We thank the reviewer for the careful assessment and constructive questions. We have revised the methodological presentation and expanded the experimental evaluation. Further details are provided in our newly submitted revised manuscript. We address the concerns below.
1. Computational graph, notation, and loss formulation.
We have redesigned Figures 1–2 and revised Sections 3.2–3.3 to clarify the full computation and unify the notation and tensor dimensions. In particular, Figure 2 now shows how type-specific stems and validity-aware channel pooling produce one global token and local tokens. After the shared Transformer and adapters, the global-token state h0 and the mean of valid local-token states hˉ are concatenated and mapped by the shared observation projection to et (Eq. 1).
Section 3.3 and Eqs. (2)–(3) now specify the two pretraining computations and their losses: ISM reconstructs masked local descriptors using a type-specific reconstruction head, whereas IDM uses a shared GRU to predict the current unmasked observation embedding from its history, with a stop-gradient target. Appendix B provides the network dimensions, masking rules, and optimization details.
2. Statistical analysis and rank-based evaluation.
Following the reviewer's suggestion, we have added paired seed-wise statistical analyses, including 95% confidence intervals, exact Wilcoxon signed-rank tests, and Holm correction (Section 4.4 and Appendix G). These include comparisons between CORD (Multi-domain) and CORD (Single-domain) (Table 32), as well as supplementary comparisons with XGBoost (Table 33), complementing the baseline evaluation in the revised Table 5.
We have also introduced an average RMSE rank in Table 5. Among the eleven methods evaluated across all nine Level-I settings, CORD (Multi-domain) achieves the best average rank (1.33), providing an additional cross-setting comparison beyond individual RMSE values.
3. Baseline selection, RUL-specific methods, and ModernTCN.
We have reorganized the RUL prediction discussion in Section 2 and expanded the baseline comparisons in Section 4.3. We have added four methods: ModernTCN, Regression Shapalet–GNN for bearings, Battery Transformer for batteries, and TCN-BiLSTM-Attention for cutting tools (Section 5.3, Table 5, Appendix E).
TCN remains as a conventional temporal-model baseline, while ModernTCN is now explicitly evaluated as suggested by the reviewer. RUL-specific models retain their native input processing and backbone architectures; all methods use matched downstream splits, label budgets, seeds, and metrics.
We report cases where these specialized predictors outperform CORD, as well as CORD's overall performance across system types.
4. Head-only ablation.
We have added a Head-only experiment in Section 5.4, Table 7, and Appendix F.1. It removes the learned representation network and trains the target-specific RUL heads directly on parameter-free aggregates of observation descriptors, using matched data splits and 10% labels under the same 10%-label setting as the Frozen experiments.
Compared with Head-only, the complete Multi-domain encoder reduces RMSE from 0.1160 to 0.1087 for bearings, 0.0707 to 0.0704 for batteries, and 0.2030 to 0.0864 for cutting tools.
The contribution is particularly pronounced for cutting tools, while the differences are smaller for bearings and batteries.
5. Code availability and organization of contributions.
We have added an anonymous code repository link in the Abstract, with implementations, experiment configurations, and retained records described in the Reproducibility Statement.
We have also reorganized the Introduction's contributions into two points, combining the closely related contributions identified by the reviewer: the cross-system representation-learning framework and empirical evidence of transferability across datasets and system types.
We thank the reviewer again for the feedback, which helped improve both the clarity and experimental support of the paper.