- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors describe that the temporal tabular and irregular time-series data are currently considered different modalities but can support cross-domain model reuse when underlying information is available. Therefore, they propose a framework to repackage available temporal tabular tasks into irregular time-series tasks and vice-versa.
The authors highlight entity collapse and temporal relation mismatch when converting from temporal tabular to irregular time-series. By recovering entity-specific histories, the authors enable irregular time series models to operate on temporal tabular tasks. Temporal embeddings and entity specific context adapt the tabular model ModernNCA to be applied to irregular time-series datasets.
Critical strengths
S1 Interesting framework for temporal tabular and irregular time-series. It is addressing entity collapse and temporal relation mismatch compared to a naive cross-domain transfer.
S2 Practical demonstration of the proposed protocol through adapting ModernNCA to irregular time-series.
Critical weaknesses
Broader evaluation
While the authors acknowledge that they are currently limiting tabular-to-time-series recovery to EO and WE in section 6.2, the limited evaluation of tabular to time-series recovery also limits the contribution of this paper. The paper’s evaluation should be extended to broader irregular time-series and temporal tabular data to support its applicability across domains, ideally including cases where underlying histories are incomplete. That would provide a more rigorous evaluation of the framework and its applicability and boundaries. Without this broader evaluation or clearer criteria for when cross-domain model reuse is valid, the contribution appears modest.
Questions for authors
Q1 Could you please report the standard deviations and confidence intervals for the 15 random seeds of all reported results?
Q2 Could you please provide ModernNCA (+c) in table 3 as a control to the rationale provided in section 5.2?
Q3 Could you please include further datasets for evaluation and derive applicability criteria?
2 comments
Thanks for providing the additional information and explanations.
However, given the limitation described in W1/Q3, I will keep my rating.
Thank you for carefully reviewing our paper and for your constructive suggestions on the scope of the experiments and the reporting of results.
We acknowledge that we have used only EO and WE as representative cases to study the use of irregular time-series models on temporal tabular tasks, and that the empirical coverage in this direction is still limited. The two cases examine different protocol issues. WE examines entity collapse caused by interleaving records from different stations. EO examines temporal relation mismatch caused by row-level summaries that hide the source transaction sequences. Other temporal tabular tasks can be converted to the input format of irregular time-series models, but the resulting input may be a poor fit for these models and lead to weak performance. For how we identify this mismatch, please see our response to Q1 from Reviewer F1kq.
We believe this is largely a limitation of the datasets themselves. When information about the meaning of the records is missing or the entity information is unclear, it can be inherently difficult to convert a dataset into a form that an irregular time-series model can use. The three irregular time-series datasets in Table 3 examine adaptation in the reverse direction using the tabular model ModernNCA. The adapted context-based tabular model is competitive on both tabular and time-series tasks, which may suggest that this approach is a more general way to handle such tasks. We will further explore datasets from the BeyondArena benchmark.
We will add the standard deviations shown below. Please also see the significance test results in our response to W2 from Reviewer 4Whv.
These results show that ModernNCA yields more stable predictions, and the appendix also shows that it has lower computational cost.
Table 3 currently reports only (+ec) and does not include (+c). In temporal tabular tasks, the model has input features in addition to timestamps and can make predictions using those features alone, ignoring timestamps entirely. Thus, (+e) and (+m) are optional, and (+c) can be used on its own. In irregular time-series extrapolation and interpolation tasks, however, a tabular model needs the timestamp (or its encoding) as input to make a prediction, and often there are no other features. In this setting, (+c) would mean “using information from the historical window while ignoring timestamp information” and cannot be used on its own.