acceptodds
Withdrawn from ICLR 2027

Bridging the Experience Gap: Semantic Retrieval and Conditional Residual Transfer for Time Series Forecasting

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Time series forecasting draws on historical observations, but abundant historical data does not necessarily provide relevant experience for a particular forecast. An entity may face conditions absent from its own history, while useful experience exists across other entities and contexts. Drawing on this experience presents two challenges: 1) identifying relevant historical cases through semantic connections rather than numerical similarity; 2) adapting their responses across differences in timing, magnitude, and shape to improve the target forecast. To address these challenges, we propose , a plug-and-play framework for augmenting frozen forecasting models. It retrieves semantically analogous historical cases and adapts their forecast residuals to correct the target forecast. , a large language model jointly characterizes entity attributes, historical states, and known future conditions, exposing contextual connections that guide the retrieval of potentially transferable residuals. , the retrieved residuals are aligned with the target conditions. Learned directional gain estimates and candidate interactions then guide the joint selection and weighting of residual corrections. By combining semantic retrieval with explicit response adaptation and joint utility assessment, the framework enables forecast correction when direct historical matches are unavailable. Our evaluation examines forecasting accuracy, transfer across entities and contexts, and negative transfer across multiple forecasting backbones. Code is available at https://anonymous.4open.science/r/TextRAG-F67B.

Primary area:
learning on time series and dynamical systems
Keywords:
Time Series Forecasting,Retrieval-Augmented Generation,Residual Transfer

Reviews

Among:
Shape:
1234this paper, Bottom 25%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.75 over 4 reviews, above 25% of the others.
Reviewer_d4uTOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

SCoRe is a plug-and-play module that learns an additive correction to the output of a frozen backbone. It targets entities that lack direct history under a forthcoming context, such as a product with no historical records for an upcoming festival. The method has four modules. In Semantic Residual Memory, an LLM describes each forecasting scenario jointly from its history, covariates, known future conditions and entity attributes. The top-K historical cases are retrieved by cosine similarity of description embeddings, together with their normalized backbone residuals. A frozen BGE encoder provides normalized embeddings for downstream conditioning. Conditional Response Transport (CRT) warps each retrieved residual in time around calendar anchors, then applies a bounded scaling and a low-rank shape increment. Dual-branch Utility Estimation (DUE) predicts the directional gain of each transported candidate, computes G_q exactly, and approximately maximizes the estimated utility with a fixed number of Frank-Wolfe iterations starting from zero. It does this in two branches. Reference branch D uses a historical utility network and a query gate, and branch S uses a separately pretrained utility network adapted on recent fully observed windows. Regularized Correction Blending (RCB) mixes the two branches with one mixing coefficient shared across queries. The coefficient is fitted through an analytical solution on OOF corrections from rolling validation folds, and it is used only if it passes a development-set risk check. The main experiments add SCoRe to eight backbones, DLinear, TimeXer, iTransformer, PatchTST, TFT, TS-RAG, RAFT and Chronos-2, on the five EPF subsets, EDF and Bike Sharing. SCoRe lowers MSE in 53 of the 56 backbone and dataset combinations and MAE in 53, with average relative reductions of 8.31% and 5.10%. On M5 it is added to four backbones and lowers MSE by 2.73% to 13.85%. The paper also gives a progressive ablation on EDF and Bike Sharing, several mechanism analyses and three M5 case studies. In a real-world industrial retail setting, ACC rises from 67.44% to 71.45%.

Critical strengths

The correction pipeline is clearly specified and guards against temporal leakage. Eq. (4) gives the realized error reduction of the combined correction. Candidates are therefore combined through their interactions in G_q instead of being scored separately, and zero correction stays available. Eq. (8) is the correct analytical solution of Eq. (7). The temporal protocol is explicit. Lines 309-310 state that a historical case is eligible for retrieval only after its complete forecast horizon has been observed. The mixing coefficient is fitted on rolling OOF predictions from three chronological folds. Activation is decided on a later development interval. If a check fails, the method reverts to branch D or to the backbone, and all model parameters are fixed before testing (lines 263-297). Output correction leaks easily, and this protocol handles the main risks, so the design supports reading the results as out-of-sample.

The paired gains are broad and consistent. SCoRe is added to eight backbones of different kinds, including two retrieval-augmented forecasting methods, TS-RAG and RAFT, and the pretrained forecasting model Chronos-2. Lines 316-319 state that both versions use the same base-model checkpoint and input configuration. In Table 1, MSE falls in 53 of the 56 backbone and dataset combinations and stays the same at the reported precision in the other three. The largest MAE increase is 1.19%, for TS-RAG on NP. Each step of the progressive ablation in Table 2 also lowers all four metrics. These consistent gains are the main evidence that SCoRe works as a plugin.

Critical weaknesses

The experiments do not isolate the paper's central claim. The title, abstract and contributions credit the gains to semantic retrieval, which finds potentially transferable cases across entities and contexts and so "bridges the experience gap". The evidence for this has four gaps.

First, the main text has no experiment that replaces semantic retrieval with numerical or random retrieval while keeping CRT, DUE and RCB fixed. Table 2 adds modules one at a time, but only for one backbone and two datasets, and its rows match the TimeXer results in Table 1. Figure 4 compares semantic and numerical retrieval for a single M5 query without learned adaptation, and lines 446-447 say it measures retrieval quality rather than complete model performance. The description embeddings also condition CRT through its encoders, as described in lines 206-207 and 221-222. Replacing the retrieval alone would therefore not show whether the LLM descriptions are needed.

Second, the motivating case is never tested directly. Lines 041-043 report that about 45% to 50% of products have no historical records for the same festival. No result is split by whether the target entity has history under the target context. The paper also does not report what share of retrieved references come from other entities or other contexts.

Third, the public versions of the seven evaluation settings in Table 1 each contain one target series with covariates. EPF has one hourly price series and two covariates per subset. EDF is the national electricity demand of Panama, and Bike Sharing counts hourly bicycle rentals across the whole Washington, D.C. system. These settings can test transfer across contexts within one series. They test transfer across entities only if the residual memory pools several EPF subsets or datasets, and the main text does not say whether it does. M5 is the clearest public test of the motivating case, yet Table 3 covers only four backbones and reports only aggregate results.

Fourth, the mechanism analyses are indirect. Figure 3(b) shows that the utility networks rank the same transported candidates better than text scores within each query. This fits the paper's point that semantic relevance does not imply error reduction, but it does not show that semantic retrieval finds better candidates than numerical retrieval. After temporal alignment, the Pearson correlation between aligned residuals and e_q is still low, 0.04 on BS and 0.05 on EDF in Fig. 3(a).

Taken together, the results show that the full framework helps. They leave open how much of the gain comes from semantic retrieval and conditional residual transfer and how much comes from extra inputs and SCoRe training. That attribution is the paper's main claim.

The benchmark tables lack a baseline with the same information, and they report no uncertainty. Tables 1 and 3 compare SCoRe only with the original backbone. The internal comparisons in Table 2, Fig. 3(c) and Fig. 6 cannot replace a comparison with another correction method that uses the same information and fitting data. SCoRe adds trainable parts, adapts branch S on recent fully observed windows, fits its mixing coefficient on rolling validation folds, and decides activation on a later development interval (lines 247-249 and 263-284). The encoders for query and source conditions use text, known calendar features, historical statistics and base forecasts (lines 221-222). Each backbone, in contrast, uses the inputs supported by its architecture (lines 158-159). The main text does not say whether the backbones receive the same inputs and fitting data. TFT already uses known future covariates and still gains 7.30% to 19.50% in MSE, so extra information does not explain everything, but its share still needs to be measured. Useful baselines include a learned residual correction model trained on the same inputs and data, residual averaging with numerical retrieval, and the backbone refit on the same recent data. Adaptive forecasting methods that the paper already cites would also be fair comparisons. Examples are SOLID (Chen et al., 2024), which fine-tunes the prediction layer on contextually similar samples, and the test-time adaptation method TAFAS (Kim et al., 2025). Tables 1 and 3 also give no standard deviations or significance tests, and three random seeds are mentioned only in Section 4.4. Several gains are below 1%. For Chronos-2 on DE, MSE goes from 0.237 to 0.236, and for TS-RAG on BE it goes from 0.340 to 0.338.

Questions for authors

Which windows fill the residual memory? Lines 211-213 say that fitting and selection precede the forecast windows of the historical forecasts B_j^hist. For windows inside the backbone's training period, is the backbone refit on a rolling basis so that the stored residuals are out-of-sample? For a given query, does the historical text index M hold only cases whose forecast origin comes before it? Candidate rankings are precomputed (lines 205-206), and invalid candidates are masked without replenishment (lines 213-215). Later cases could then take top-K slots and shrink K_q. Does the set of eligible cases grow during testing, and what is a typical K_q?

Does retrieval cross EPF subsets or datasets? What share of retrieved references comes from a different entity or a different context than the query?

Which LLM generates the descriptions, and what does the domain metadata D_q in Eq. (1) contain, for example dataset names or absolute dates? Each description includes "a qualitative hypothesis about future trends" (lines 201-202). The paper says this hypothesis uses only available inputs and serves as a retrieval cue, not a numerical forecast (lines 202-203). The description embeddings, however, also condition CRT (lines 206-207 and 221-222). For public benchmarks whose periods an LLM may have seen during pretraining, such as M5 and EPF, how do you rule out that the hypothesis draws on remembered outcomes? An ablation that removes the hypothesis from the description would show how much it contributes.

What inputs does each backbone receive? Do DLinear, PatchTST and iTransformer get the known future covariates that SCoRe uses? Are all backbones trained up to the same cutoff as the SCoRe components?

Eq. (10) is a Laplace-type loss with location ĝ_qj and scale σ_qj, so ĝ_qj estimates a conditional median of g_qj. The utility in Eq. (4) is linear in g_q, so its expected value depends on the conditional mean of g_q. Why did you choose this loss, and do the results change with a squared-error or Gaussian loss?

Which M5 series, aggregation level, splits and horizon were used? If you used a subset, how was it chosen? Why does Table 3 include only four backbones, and how was the query in Case 1 selected?

Was the ACC gain from 67.44% to 71.45% measured in an offline back-test or an online test? Over what period, and on how many products? Was the production model retrained on the same data?

How much does SCoRe add to the cost of the backbone? Please report the number of LLM calls and the time spent generating descriptions, along with the SCoRe training and inference time.

Reviewer_dP7zOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
3
Soundness
1
Read review
Paper summary

This paper addresses the problem of time series forecasting for target entities lacking historical experience in specific contexts, proposing the residual correction framework SCoRe. This method utilizes LLM to convert historical statistics, covariates, and entity attributes into contextual descriptions, retrieves relevant historical prediction residuals, and then corrects the model's prediction through time alignment, amplitude and shape adaptation (CRT), joint utility estimation (DUE), and dual-branch fusion (RCB), while freezing the model. The authors conducted multiple forecasters'evaluations on EPF,EDF, bike-sharing and M5 datasets, and verified the method through ablation experiments and case studies.

Critical strengths

SCoRe provides a semantic retrieval module that improves forecasts using historical forecasting errors. The reported gains across multiple backbones and datasets support its practical value and suggest that its benefits extend beyond a single forecasting architecture.

Critical weaknesses
  1. The incremental contributions of semantic retrieval and conditional transfer have not been fully identified. The text description mainly comes from existing statistics, covariates, and metadata, while the existing experiments lack direct residual prediction, structured feature retrieval, and template text retrieval comparisons under the same input conditions. Therefore, it is unclear whether the benefits mainly come from the semantic representation of LLM, or the additional conditional information and trainable residual correction; the progressive module ablation is not sufficient to fully distinguish these factors, which affects the judgment of the new knowledge added by the method.

  2. Current experiments is not strong enough to fully validate the method. The datasets are not sufficiently diverse and most of them are only have one entity (EDF, EPF, Bike Sharing) which are not strong enought to validate the method's claim.

Questions for authors
  1. Does text generation introduce new semantic information beyond the dataset? If not, could author inject the additional semantic information into the text description to further improve the performance of the method?
  2. Could author compare diffenent fixed text template for LLM-generated description?
  3. Could author replace semantic retrieval with numerical retrieval to see if the performance is still improved?
  4. Could authors provide more diverse datasets with multiple entities to validate the method's generalizability and robustness?
  5. What are the costs of offline description generation and index construction, and what are the end-to-end inference delays including text generation, retrieval, and correction?
  6. The comparison and attribution of the closest method and contributions are still insufficient. Although Table 1 includes RAFT and T-RAG, the experiments mainly show the additional benefits of SCoRe over these models. Currently, there is still no direct comparison with retrieval methods like TS-RAG, RAFT, GTR and SARAF. Could authors provide more direct comparisons with these methods to clarify the incremental contributions of SCoRe?

references:

[1] Kanghui Ning et al. TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecaster. NeurIPS, 2025.

[2] Sungwon Han et al. Retrieval Augmented Time Series Forecasting. ICML, 2025. (RAFT)

[3] Fanpu Cao et al. Enhancing Multivariate Time Series Forecasting with Global Temporal Retrieval. ICLR, 2026. (GTR)

[4] Shiqiao Zhou et al. Stationarity-Aware Retrieval-Augmented Time Series Forecasting. KDD, 2026. (SARAF)

Reviewer_5RwQOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

SCoRe addresses forecasting when a target entity lacks experience under forthcoming conditions. It augments a frozen forecaster by retrieving historical forecast residuals through LLM-generated joint-context descriptions. Conditional temporal alignment, amplitude scaling and low-rank shape adaptation transform these residuals. Predicted directional gains and candidate interactions then determine their combination. Historical-reference and recently adapted branches are blended using a bounded coefficient fitted through rolling validation, with activation decided on a development interval. Table 1 covers eight backbones and seven settings. MSE and MAE each improve in 53 of 56 combinations, with average relative reductions of 8.31% and 5.10%, respectively. Additional results cover M5 and industrial retail forecasting. These findings support general forecasting augmentation, but do not directly establish the claimed transfer across experience gaps.

Critical strengths

S1. The method has a coherent design. SCoRe separates candidate discovery, response adaptation and joint utility assessment, while retaining zero-correction and backbone fallback options (pp. 4-6, Sections 3.2-3.5). This directly addresses the possibility that a relevant historical case may not improve a forecast. The separation is the paper's strongest methodological contribution.

S2. The paired evaluation has meaningful breadth. Original and augmented forecasts share frozen checkpoints and test windows across several architectures and tasks (p. 6, Section 4.1; p. 7, Tables 1 and 3). This supports the empirical value of the complete plugin and suggests that its usefulness extends beyond one forecasting architecture.

Critical weaknesses

W1. The central experience-gap claim lacks direct validation. The abstract and contributions emphasize transfer across entities and contexts, but the experiments mainly report aggregate errors under chronological splits (pp. 1-3; pp. 6-9, Section 4). The available evaluation neither operationalizes the historical coverage of test entity-context combinations nor reports stratified or held-out-combination results. The single M5 query in Figure 4 cannot establish generalization across these conditions. Consequently, the results do not show whether improvements occur specifically where the proposed experience gap exists.

W2. The incremental contribution over existing residual correction remains unclear. RATL [1], which the paper cites, already combines frozen forecasting, residual memory, set-aware routing, zero correction and validation-selected correction strength. SCoRe adds semantic retrieval and conditional transport, but lacks comparisons with RATL and a strong residual learner using the same information. Table 2 progressively adds modules on only two datasets. Figure 3 also does not isolate Gram interactions or RCB (pp. 7-8). These results do not sufficiently distinguish the proposed mechanisms from generic supervised correction or additional input information.

[1] RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting. arXiv:2609.03937. https://arxiv.org/html/2609.03937v1

Questions for authors

Q1. How is absence of same-entity, same-context history defined and quantified in M5 or the industrial test set? Are results available for absent, sparse and sufficient history, or held-out entity-context combinations? Please identify their location and the benefit of semantic retrieval within the gap group.

Q2. Are comparisons available against RATL or a strong residual learner with matched backbones, information and temporally available training labels? With CRT and DUE fixed, what happens on the complete test set when numerical retrieval replaces semantic retrieval? These controls would materially affect the novelty assessment.

Q3. How many independent runs underlie Tables 1-3? What are the paired uncertainty intervals for small improvements and the frequency and magnitude of degradation across test blocks or events? Please clarify how dependence from overlapping forecast windows is handled. This requests clarification of the existing evidence.

Reviewer_9Lw5OpenReview ↗
Rating
2
Confidence
3
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

The article proposes a plug-and-play framework called SCoRE. It achieves superior performance and accuracy on several covariate-aware prediction benchmarks.

Critical strengths
  1. The experimental scope of the article is fairly sufficient, providing some evidence for the effectiveness of the claimed method.
  2. The motivation is pretty clear, and the proposed method is somewhat targeted towards the challenge it addresses.
Critical weaknesses

1.The article explains the two challenges very thoroughly, and I can understand it too. But it seems that the author's claimed challenges come from subjective induction. Does the experimental dataset used actually contain the described phenomena? If there is, I think the challenge stands. And if it stands, what about its universality?

  1. Regarding covariate-aware benchmarks, the current well-known work in the field is DAG (ICML 2026). However, after looking through the code, I found that the author seems to have used their own codebase. This poses a challenge for the assessment results in the text. Why not use some of the currently recognised community benchmarks, like TSL(Time-Series-Library), BasicTS+ or TFB?

  2. The experiment was tested on TS-RAG and Chronos-2. The key issue is that both models are pre-trained. After incorporating the framework proposed in this paper, is it basically an enhanced fine-tuning? If that's the case, what's the difference between fine-tuning using the framework proposed in the article and doing native fine-tuning, and how much performance improvement would it bring?

Questions for authors

See Weaknesses

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.