- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes TFMemDiff for generative time series imputation under severe missingness. The method introduces temporal and frequency memory modules to retrieve structural prototypes from historical data and uses them to guide conditional diffusion. The authors evaluate the approach on several real-world datasets under different missing patterns, with additional ablation studies and experiments on an alternative diffusion backbone.
Critical strengths
The idea of using historical time-frequency memories to guide diffusion under sparse observations is reasonable and interesting. It provides additional information when the observed sequence itself is insufficient for reliable imputation. The experimental results are generally strong across different datasets and missing patterns. The ablation studies and the evaluation with SSSD also provide useful evidence for the effectiveness of the memory modules.
Critical weaknesses
-
My main concern is the experimental comparison. Table 2 reports very large improvements over several baselines, particularly on the Stock dataset, where the errors of some methods differ by more than an order of magnitude. Although the results are encouraging, such large differences need further explanation. The appendix mentions that the baselines are implemented using different sources, but it is not entirely clear whether data preprocessing, normalization, masking, and evaluation protocols are fully consistent across methods. A more detailed explanation would make the results more convincing.
-
The novelty and the evidence for the proposed structural guidance could be further strengthened. Related ideas, such as prototype-guided diffusion and frequency-conditioned imputation, have already been explored in recent work, including ProDiff and LSCD (ICML 2025). I think the contribution of this paper lies more specifically in the joint retrieval and integration of temporal and frequency memories into conditional diffusion. In this regard, Table 1 is not particularly informative, as the selected categories do not provide a very direct comparison with existing methods. Moreover, the paper repeatedly emphasizes that FMM preserves global spectral patterns while TMM captures local temporal dependencies. However, the main evaluations rely on RMSE, MAE, and CRPS, which do not directly demonstrate how well the frequency structure is preserved. More direct evidence would help support this claim.
Questions for authors
-
Could the authors clarify whether the baseline results in Table 2 were reproduced under a unified experimental protocol or taken from existing implementations and reported results? In particular, how were normalization, masking, and evaluation settings kept consistent? What explains the unusually large performance gaps on Stock?
-
Could the authors further clarify the methodological difference between TFMemDiff and existing prototype-guided or frequency-conditioned diffusion methods, particularly ProDiff and LSCD? What is the main benefit of combining the two memory domains beyond using either one separately?
-
Is there any direct evidence that FMM improves the preservation of global frequency structures, such as spectral reconstruction errors or dominant-frequency consistency? If not, could the authors clarify the extent to which the current experiments support this claim?
2 comments
Clarification on the Updated Overall Rating
Dear Reviewer hHuN,
Thank you for your time and consideration. We noticed that the overall rating changed from 3 to 2, while the written comments appear unchanged. As the discussion period is nearing its end, we wanted to briefly check whether this update was intentional or perhaps an inadvertent change. If intentional, we would appreciate a brief note on any remaining concerns.
Thank you again for your feedback.
We sincerely thank you for your constructive comments and valuable suggestions. We appreciate your time and effort in reviewing our work. Below, we address your comments point by point.
Q1: Clarification of Baseline Reproduction, Experimental Consistency, and Stock Performance.
A1: We sincerely thank the reviewer for raising this important concern.
Regarding baseline reproduction, as described in Appendix F.3, most baselines are implemented using the unified TSLib framework, while the remaining methods are adopted from their official repositories. The results in Table 2 are obtained from our experimental implementations rather than directly copied from published results.
Regarding experimental consistency, all methods are evaluated on the same dataset splits and under the masking configurations described in Appendix F.2. We also use the same evaluation metrics, computed exclusively on masked entries, as specified in Appendix F.4. We will further clarify the preprocessing and normalization procedures to make the experimental protocol more transparent.
Regarding the performance on Stock, we believe it may be related to the dataset characteristics and the ability of our model to exploit historical patterns. Stock is a relatively low-dimensional daily multivariate dataset, whose six financial variables may contain reusable cross-variable patterns. By retrieving representative historical prototypes, TFMemDiff provides additional structural references for conditional denoising, which may be particularly beneficial under severe block missingness. We will clarify this explanation in the revised manuscript.
Q2: Methodological Differences from ProDiff and LSCD and Advantages of Dual-Domain Memory.
A2: We sincerely thank the reviewer for this insightful question.
As outlined in the contributions of the original manuscript, our main contribution is to identify the limitation of instance-only conditioning under extreme observation sparsity and introduce historical structural prototypes as complementary guidance for conditional diffusion. While ProDiff uses historical human movement prototypes and LSCD incorporates frequency information from current incomplete observations, TFMemDiff integrates historical prototypes from both temporal and frequency domains into conditional score estimation, thereby supplementing sparse observations with complementary structural guidance. The main differences are summarized below:
We will revise Table 1 to include ProDiff and LSCD and provide a more direct comparison of the methodological differences.
Regarding the benefit of combining the two memory domains, TMM provides adaptive temporal references, while FMM captures complementary spectral information. Their joint retrieval enables conditional denoising to exploit both temporal dependencies and frequency-domain characteristics. This complementarity is supported by the ablation results in Table 3: removing either memory degrades performance, while removing both leads to the greatest degradation. We will further clarify the complementary roles of the two memories and the supporting ablation results in the revised manuscript.
Q3: Evidence for FMM's Global Frequency Structure Preservation.
A3: We sincerely thank the reviewer for raising this important question. To provide direct evidence, we introduce Power Spectrum Discrepancy (PSD-Dist) and Autocorrelation Discrepancy (ACF-Dist) to evaluate spectral and temporal structural consistency, respectively. We compare TFMemDiff with its variant without FMM across different missing patterns on ETTh1 and Stock(reported as PSD-Dist / ACF-Dist):
As shown in the table, TFMemDiff consistently achieves lower PSD-Dist and ACF-Dist across all evaluated settings. This improvement can be attributed to FMM retrieving representative global spectral patterns from historical training representations in the frequency domain, thereby providing additional spectral references that help preserve global frequency structures and temporal correlation consistency. We will incorporate these additional evaluations and clarify the corresponding claims in the revised manuscript.