- Rating
- 2
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes VQ-PACT, a text-conditioned time-series generation framework combining factor-specific vector-quantized codebooks, phrase-level semantic grounding, an autoregressive compositional prior, and selective constraint realization. The framework is evaluated on twelve real-world datasets, Synth-U, and Time-MMD, with additional analyses of fidelity, controllability, generalization, and computational efficiency.
Critical strengths
- The paper addresses a meaningful problem and presents a comprehensive generation pipeline. The factorized representation is intuitively motivated, and the evaluation covers diverse datasets and multiple complementary metrics.
- The paper's multifaceted evaluation provides a more comprehensive perspective for assessing time series models.
Critical weaknesses
-
Lack of clarity in methodological presentation and training pipeline. The paper is difficult to follow due to unclear methodological descriptions and insufficient implementation details. First, Figure 2 contains four subfigures (a–d), yet its caption provides no explanation of their respective roles. Moreover, Appendix F "Full Objective" section introduces eight loss terms for Stage 1 representation learning, making a complete training pipeline or pseudocode essential for understanding how these objectives are integrated and optimized. Also, several key components and notations are introduced without clear definitions. For example, the auxiliary decoders D_f and the joint decoder Dec (Lines 174–178) are not explicitly defined. Similarly, Appendix F.2 introduces regional supervision as part of the training procedure, but its implementation and execution are not clearly explained. Additionally, the meaning and role of the descriptor vocabulary remain ambiguous. The statement in Line 227, "Code cross-entropy and attribute regression supervise complete programs," also raises an important question: at which training stage are these supervision objectives applied? Overall, the methodological presentation lacks clarity and coherence, making the proposed framework unnecessarily difficult to understand and reproduce.
-
Insufficient attribution of the main performance gains. Appendix Table 14 shows that Event Joint increases from approximately 10% for learned proposals to 93% after deterministic realization. This raises the question of whether the reported controllability primarily arises from the proposed compositional representations or from the rule-based realization mechanism.
-
Insufficient explanation of Factor-OOD evaluation and computational efficiency. Section 4.5 introduces the Factor-OOD evaluation without clearly defining it in the main manuscript. Consequently, it is difficult to understand the experimental setup and, more importantly, how this evaluation directly supports the claimed contributions of VQ-PACT. The authors should clarify the definition, motivation, and relevance of Factor-OOD to the proposed method. Furthermore, the analysis of Computational Cost is insufficient given the complexity of the proposed framework. In particular, Stage 1 involves eight loss terms, suggesting a potentially substantial training overhead. A convincing efficiency evaluation should report training memory consumption, the execution time of individual modules, and overall training time or FLOPs. Without these measurements, it is difficult to assess the actual computational cost of VQ-PACT or substantiate its efficiency claims, especially considering the complexity of its architecture and training objectives.
Questions for authors
Please refer to Critical Weaknesses
Follow-up on the Event Joint Gain and the Contributions of the Eight Training Losses
Thank you for your further feedback. To directly address your concerns, we conducted additional controlled experiments to identify the sources of the Event Joint improvement and evaluate the individual and combined contributions of all eight training losses. We are committed to transparency and will release our training and evaluation code, ablation configurations, and experimental logs to support independent reproduction and verification. The results are presented below.
Q2: What accounts for the increase in Event Joint from approximately 10% to 93% after realization?
R2: To directly identify the source of this improvement, we further decomposed local event realization into two operations: background completion and text-specified event template insertion. We conducted an additional controlled experiment to quantify the contributions of these two operations.
Specifically, we enabled or disabled each operation independently while keeping the same batch of generated proposals fixed:
The results provide three findings:
These results clarify the performance attribution: the substantial increase in Event Joint is mainly driven by deterministic local event realization, rather than the learned representation alone. The learned generator provides the initial sequence, while event templates and background completion enforce the requested local events. We will explicitly distinguish the performance before and after realization and incorporate these controlled comparisons into the revised manuscript.
Q3: What does each of the eight training losses contribute, and are they all necessary?
R3: We conducted individual and combined loss ablations, retraining the representation model and its corresponding generator for each setting while keeping local event processing fixed. The complete model achieves the highest post-realization Event Joint, and full-sequence reconstruction makes the largest contribution.
“Keep only” refers to Stage 1 training losses. All variants retain discrete codebooks, hard quantization, and subsequent generator training.
Removing full-sequence reconstruction reduces Event Joint from 14.85% to 2.88% before realization and from 93.10% to 42.68% afterward. This demonstrates that the same event-processing procedure cannot fully compensate for poor initial proposals.
Removing any one of the other seven losses yields 84.76%–86.15% post-realization Event Joint, below the full model's 93.10%. However, simpler objectives can sometimes achieve higher accuracy before realization. For example, retaining only full-sequence reconstruction gives 17.45% before realization but 85.21% afterward. These results show that the full objective performs best on post-realization Event Joint among the tested settings, although the eight losses have different effects and are not necessarily indispensable for every evaluation metric.
We sincerely thank the reviewer for these constructive comments and careful consideration. We hope our additional experiments and clarifications address your remaining concerns and strengthen your confidence in our work.