- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
TRACS selects time-series pretraining data using statistical features, GMM clustering, balanced cluster quotas, within-cluster sampling, and a final repair step for missing binary feature patterns. It provides conditional coverage and distributional bounds. Under a fixed 10B-token budget, selected subsets improve aggregate forecasting metrics across three architectures.
Critical strengths
- The method makes an explicit, checkable distinction between spreading samples through feature space and retaining every reachable discrete pattern. The repair procedure preserves subset size and gives a concrete coverage guarantee under the stated feasibility condition.
- The experiments control the processed-token budget and cover three architectures with five seeds. Table 2 shows that selected subsets can outperform full-corpus training under this control. The per-task results and bootstrap analyses also make the variability of the gains visible.
Critical weaknesses
- The closest baseline is substantially modified. BLAST-style replaces the original features with F1–F7 and removes grid mixup, while TRACS uses a richer 27-dimensional clustering representation (Section 5.1 and Appendix E). The paper acknowledges this, but without the original baseline or a matched-representation comparison, the advantage of the proposed selection procedure over the closest existing approach remains uncertain.
- The evidence that pattern repair improves forecasting is weaker than the interpretation in Section 5.3. The No Swap subset misses nine patterns, so repair replaces nine series in a subset of roughly 300,000, yet Table 3 attributes a MASE reduction from 1.0892 to 1.0500 to this step. Such an effect is possible, but the corresponding task-bootstrap interval includes zero, as do all component-ablation intervals in Table 15. These results do not yet distinguish a reliable benefit from training variability or unusually influential replacement series.
Questions for authors
- Does the advantage remain against the original BLAST implementation, and when both selection pipelines use the same input features?
- How many training windows or tokens do the nine replacement series contribute? Can paired runs and a control with nine random replacements establish that recovering the missing patterns explains the reported forecasting gain?
2 comments
W2 / Q2 Forecasting effects of pattern repair and ablation evidence
Following your suggestion, we added two sets of comparisons. One set compares the full configuration with No Swap using a larger dataset, a broader evaluation scope, and more random seeds; the other adds Random Swap with the same number of replacements to further compare repair guided by missing patterns with random replacement.
(1)
We added paired ablations of the full configuration and No Swap on a larger candidate corpus and more downstream evaluation configurations and increased the number of random seeds. The results show that, after adding repair, overall forecasting error is lower and performance is better on most evaluation configurations, with the statistical comparison also supporting this difference. This improvement can still be observed after expanding the scale of the experiments and increasing the number of repeated runs, providing more substantial evidence for the practical role of repair than the original manuscript provided.
(2)
We also added Random Swap as you suggested, keeping its number of random replacements the same as that of pattern repair. In this comparison, the full configuration still has lower overall forecasting error and performs better on most evaluation configurations, with the corresponding statistical comparison also supporting this difference. In other words, with the same number of replacements, repair guided by missing patterns achieves better forecasting performance than random replacement, which further supports our reasoning for designing the repair step this way.
These two sets of results give us a stronger basis for explaining that repair also has an effect on downstream forecasting and that targeted replacement is more effective than random replacement. We will add these results to Section 5.3, with the detailed ablation performance and statistical comparisons shown in the table below.
| Variant | MASE | Change vs. Origin (%) | Bootstrap interval (Origin variant) | W/T/L |
|---|---|---|---|---|
| Origin (TRACS-50%) | 0.00 | -- | -- | |
| +1.92 | 58/0/39 | |||
| +3.35 | 67/0/30 | |||
| +1.04 | 57/0/40 | |||
| Proportional quota | +3.52 | 76/0/21 | ||
| Random within-cluster selection | +2.43 | 63/0/34 | ||
| No Swap | +5.38 | 74/0/23 | ||
| Random Swap | +2.84 | 72/0/25 | ||
| No entropy guidance | +4.67 | 79/0/18 |
The revised PDF and supplementary material have been uploaded. In the annotated PDF, green margin labels marked wP7C identify revisions addressing your comments, with the relevant weakness and question numbers shown in each label. Shared revisions may carry labels for more than one reviewer. We welcome further discussion of the baseline comparisons and repair evidence and would be glad to clarify any remaining points.
Thank you for your careful reading of the paper and your thoughtful consideration of the baseline comparisons and the experimental evidence for pattern repair. To address these issues, we have added baseline and ablation experiments. We respond to your comments point by point below.
W1 / Q1 BLAST baseline adaptation and data-selection comparisons
Regarding the difference in the BLAST configuration that you pointed out, we have added a comparison using its original statistical indicators and selection procedure. Here, we respond to your comments in three parts, explaining how the baseline is configured, how the representations of the two methods enter the comparison, and what results the additional experiments obtained.
(1)
The added comparison retains BLAST’s original statistical features, encoding, UMAP projection, and grid selection configuration, disables only Grid Mixup, and is still labeled BLAST-style in the table. We also added Training Diet and LP-Mirror to further supplement the baseline comparisons. However, we still insist on excluding Grid Mixup because it is itself an independent data-augmentation method that constructs new training samples by mixing existing sequences. If it were retained only for BLAST, it would be difficult to distinguish whether the forecasting differences come from data selection or additional data augmentation. Therefore, we hope to better observe the data-selection effects of the respective frameworks when neither uses Mixup.
(2)
TRACS uses a 27-dimensional statistical representation that we designed to characterize temporal structure more fully during the preceding clustering stage, while the final pattern definitions and coverage checks still use a seven-bit encoding. This experiment retains the respective input representations and selection procedures of the two methods and uses the same candidate corpus, retention ratio, and training budget. We compare the forecasting performance of the respective complete selection frameworks, which also includes the joint effects of the input representation and the selection procedure.
(3)
We expanded the candidate corpus from approximately 600,000 to approximately 2,170,000 sequences and also increased the number of training seeds from 5 to 7. The additional comparisons cover five architectures, MOMENT, PatchTST, Timer, Chronos2-small, and Toto2-22M, with evaluation across 97 downstream evaluation configurations. The results show that, after restoring BLAST’s original statistical indicators, TRACS still achieves lower forecasting error for every reported model and retention ratio. This shows that TRACS retains its forecasting advantage when BLAST uses its own configuration and the evaluation scope is expanded, with the detailed results shown in the table below.
Forecasting error comparison. Lower geometrically aggregated MASE is better; we report the mean ± standard deviation across 7 seeds.