- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DualGround-TS for event-conditioned time-series forecasting. It addresses two issues: forecasts may fail to use the relationship between events and historical series, and explanations may cite evidence that does not affect the forecasts. The method uses observed future outcomes to constrain cross-modal representations and tests explanations by retaining or removing cited evidence. It is evaluated on TimeLitmus, CiK, and Time-MMD.
Critical strengths
-
Compared with standard task fine-tuning of the same backbone, DualGround-TS improves all reported TimeLitmus metrics and reduces forecasting error across all nine Time-MMD domains.
-
Testing whether forecasts use the relationship between events and historical series, and whether explanations are supported by model behavior, has practical value.
Critical weaknesses
-
The paper introduces several new terms. In particular, “hollowness” appears to combine shortcut learning and unfaithful explanations without explaining how it differs from these established concepts. This makes the paper harder to follow.
-
The diagnostic experiments cover only two TimeLitmus domains and one backbone model. CiK and Time-MMD report only forecasting error, leaving it unclear whether the diagnostic findings extend to other tasks or models.
-
The paper suggests that prior methods focus mainly on forecasting accuracy or the surface plausibility of explanations. However, TimeX and TimePNS have used interventions to assess explanation faithfulness. The paper also omits TESS, which studies whether forecasting models effectively use textual information.
Questions for authors
-
What does “hollowness” capture beyond shortcut learning and unfaithful explanations?
-
Do the diagnostic findings hold in other domains and with other backbone models?
-
How does the paper account for intervention-based faithfulness studies and TESS’s analysis of text use in forecasting?
7 comments
Response to Reviewer qiPC [Part 2]
W2: The diagnostic experiments cover only two TimeLitmus domains and one backbone model. CiK and Time-MMD report only forecasting error, leaving it unclear whether the diagnostic findings extend to other tasks or models.
We sincerely appreciate your recognition that DualGround-TS improves all reported TimeLitmus metrics and reduces forecasting error across all nine Time-MMD domains compared with standard task fine-tuning. These results establish the effectiveness of our framework in the tested settings. The next question is how broadly the evidence-use improvements transfer. We agree that forecasting accuracy and direct grounding behavior require different tests. Our TimeLitmus and held-out interventions directly measure evidence use, and new Qwen3.5-4B and Llama-3.1-8B experiments test it across backbone sizes and families, while CiK and Time-MMD assess predictive usefulness under different tasks.
(1) What our evaluation covers. We evaluate the full TimeLitmus diagnostic benchmark across its Finance and Traffic domains. It directly tests how predictions and explanation-associated evidence respond to controlled changes. CiK covers five contextual forecasting categories under zero-shot evaluation, and Time-MMD covers nine real-world domains under native supervised evaluation. The two external benchmarks test whether the model also forecasts well on independent tasks; they do not directly use TimeLitmus's faithfulness measures. We have clarified this distinction in .
(2) Matched comparisons on independent benchmarks. Complete results appear in , with key comparisons in .
| Variant | CiK Average RCRPS ↓ | Time-MMD Average Normalized MSE ↓ |
|---|---|---|
| Task FT | 0.285 | 3.8067 |
| Architecture-matched Task-only | 0.283 | 3.4385 |
| Future-only | 0.267 | 2.8127 |
| Behavioral-only | 0.274 | 2.9838 |
| Full | 0.244 | 2.1842 |
(3) New intervention tests. We also evaluated 200 instances with unseen event paraphrases, irrelevant metadata, lexical distractors, and alternative evidence masks. The detailed procedure and results appear in .
| Variant | Prediction Invariance (%) ↑ | Evidence Stability (%) ↑ | Explanation Consistency (%) ↑ |
|---|---|---|---|
| Task-only | 85.5 | 72.0 | 73.0 |
| Full | 92.0 | 85.0 | 88.0 |
Findings.
(1) Forecasting improves on both independent benchmarks. Full reduces CiK average RCRPS by 14.4% versus Task FT, with improvements across five context categories, and Time-MMD average normalized MSE by 42.6%, with lower error in all nine domains.
(2) The model also becomes more stable under new interventions. Compared with Task-only, prediction invariance improves by 6.5 points, evidence stability by 13.0, and explanation consistency by 15.0.
(3) Grounding also improves on additional backbones. We compare Task-only and Full on Qwen3.5-4B and Llama-3.1-8B, using both Finance and Traffic and three seeds per configuration (). Full improves Sufficiency and Comprehensiveness in all four backbone–domain settings, with all eight paired 95% CIs excluding zero.
Overall, the three benchmarks provide complementary evidence: TimeLitmus directly measures evidence use, while CiK and Time-MMD show useful forecasting benefits on independent tasks and domains. The additional interventions and cross-backbone results strengthen the grounding analysis beyond the original perturbation types and backbone.
Response to Reviewer qiPC [Part 3]
W3: The paper suggests that prior methods focus mainly on forecasting accuracy or the surface plausibility of explanations. However, TimeX and TimePNS have used interventions to assess explanation faithfulness. The paper also omits TESS, which studies whether forecasting models effectively use textual information.
We sincerely appreciate your constructive comments and your recognition of the practical value of checking whether predictions use event–history evidence and whether explanations are supported by model behavior. Our contribution is to study these requirements together in the same prediction-and-explanation system. Better text use alone need not rule out a shortcut; behaviorally faithful explanations can still faithfully describe a shortcut-based predictor. We agree that intervention-based explanation methods and prior work on text use should be represented accurately. We have therefore expanded the comparisons with TimeX, TimePNS, and TESS and clarified how our two training objectives address the linked requirements.
(1) What the related methods already contribute.
TimeX [1] trains an interpretable surrogate to preserve important aspects of a pretrained time-series model's behavior. It establishes why an explanation should reflect what the prediction model actually does.
TimePNS [2] uses counterfactual necessity to identify temporal evidence that matters for a prediction. It advances learning and evaluating explanations through interventions.
TESS [3] converts textual descriptions into meaningful temporal signals, helping forecasting models use information such as changes in magnitude, shape, volatility, and lag.
These are important foundations for our work. Our contribution is not the first use of textual context, contrastive learning, or intervention-based explanation methods.
(2) What remains important when these directions are considered together?
Using text effectively does not necessarily mean that a model learns how the same event can have different implications under different historical conditions. And identifying influential evidence does not necessarily mean that a generated explanation correctly describes its role.
More importantly, a faithful explanation may faithfully describe a shortcut, while a well-grounded prediction may still have an unsupported explanation. This is the shared reliability problem captured by Hollowness. It explains why improving either capability on its own is not enough for an event-conditioned prediction-and-explanation system.
(3) What DualGround-TS adds.
Future Grounding keeps the history and observed future fixed while changing the event. The model learns which event–history combination better fits what actually happened afterward, rather than relying on input matching alone.
Behavioral Grounding works within the same model that generates the prediction, natural-language explanation, and selected temporal and textual evidence. It trains the evidence attached to the explanation using the prediction's response to retaining, removing, or adding irrelevant information.
The two objectives are applied to a shared representation, and the architecture-matched ablation in shows different benefits: Future-only improves Event CF-PC by 17.38 points, while Behavioral-only improves Sufficiency by 7.04 points and Comprehensiveness by 13.60 points.
Findings.
(1) Prior work provides strong foundations for both text use and behavior-based explanation.
(2) Hollowness reveals why neither addresses the whole evidence-use problem in a prediction-and-explanation system on its own.
(3) Our two objectives train the two necessary links together, with separately measurable improvements.
Overall, DualGround-TS connects these research directions through one practical reliability principle: predictions should depend on the intended event–history evidence, and explanations should accurately reflect that dependence. This provides a systematic way to define reliable evidence use, train for it, and test it in event-conditioned forecasting.
References
[1] Queen et al. Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency. NeurIPS, 2023.
[2] Ma et al. Beyond Sufficiency: Time Series Explanation with Counterfactual Necessity. arXiv:2607.21573, 2026.
[3] Li et al. From Text to Forecasts: Bridging Modality Gap with Temporal Evolution Semantic Space. ICML, 2026.
Response to Reviewer qiPC [Part 1]
Thank you for your thoughtful and constructive review. Below, we address each concern and summarize the additional evidence and manuscript changes.
We sincerely appreciate your thoughtful comments, especially your recognition that testing whether forecasts truly use the event–history relationship and whether their explanations are supported by model behavior has practical value. Hollowness reveals a shared failure pattern behind shortcut-dependent predictions and behaviorally unsupported explanations: apparent evidence use does not guarantee behaviorally valid predictive dependence. Addressing either failure alone is insufficient for reliable prediction and explanation. Hollowness thus provides a unified reliability goal with two complementary, testable requirements. We have made this contribution explicit in the revised manuscript.
(1) Why do these two failures need to be studied together?
The shared failure pattern manifests in two distinct ways:
A faithful explanation may describe a shortcut-based prediction, while a correctly grounded prediction may still have an unsupported explanation. Neither case ensures reliable prediction and explanation. This motivates two necessary checks: whether predictions depend on the intended event–history evidence, and whether explanations reflect the evidence supporting those predictions.
Figure 1 illustrates both failures: 73.6% of baseline-correct controlled pairs fail the full counterfactual diagnostics, while 81.0% of cited-factor interventions lack the fully expected predictive transition in their respective tests. We have strengthened this explanation in Sec. 1, Sec. 3, and Figure 1.
(2) What does this unifying view let us do?
It turns a general concern about reliability into two clear requirements that guide the same model:
Both operate on the shared representation used for prediction and explanation. The result is a practical way to test where the evidence chain fails and train both parts of it. We clarify these requirements in Secs. 4.3–4.4 and Figure 2.
(3) Do the two requirements improve different behaviors?
We evaluated four variants with the same architecture and 61.74M trainable parameters, changing only the objectives. Complete results appear in Appendix J.1.
Findings.
(1) Future-only improves Event CF-PC by 17.38 points, showing better responses to event changes.
(2) Behavioral-only improves Sufficiency by 7.04 points and Comprehensiveness by 13.60 points, showing stronger behavioral support for selected evidence.
(3) Full improves both within the same architecture.
Overall, Hollowness identifies a shared evidence-use failure behind shortcut-dependent predictions and unsupported explanations. This unified view provides two complementary requirements for designing, training, and evaluating more reliable event-conditioned prediction systems.
References
[1] Queen et al. Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency. NeurIPS, 2023.
[2] Ma et al. Beyond Sufficiency: Time Series Explanation with Counterfactual Necessity. arXiv:2607.21573, 2026.