- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HyOT, a trajectory-aware loss for long-horizon time-series forecasting. It keeps the existing forecasting models unchanged and replaces MSE with a loss combining a cardinal branch for residual information and an ordinal branch for local ranking transitions. Experiments on five models, six datasets, and four forecasting horizons show overall improvements over MSE and several existing structural losses.
Critical strengths
i) The paper provides a well-motivated trajectory-aware alternative to pointwise MSE. It explicitly considers temporal evolution and local ordering, which are not directly captured by standard pointwise MSE. ii) The proposed loss includes nontrivial mathematical design in both the cardinal and ordinal branches. The paper provides theoretical justification for the residual formulation and introduces an overlap-constrained ordinal transition representation. iii) The experiments cover multiple backbones, datasets, and forecasting horizons. The results suggest that the proposed loss is broadly applicable across different forecasting models and settings.
Critical weaknesses
i) The framework-level novelty is somewhat limited. HyOT does not introduce a new forecasting architecture, and the final objective is a weighted sum of two independently designed loss branches. ii) The novelty relative to prior work is not sufficiently clarified. Several ingredients, such as Hyvärinen scoring, permutation patterns, and Plackett–Luce ranking, are established concepts, so the paper should more clearly explain what is fundamentally new. iii) The validation of the trajectory-specific claim is relatively limited. The dedicated trajectory metrics are reported only in a representative setting, rather than across multiple datasets, backbones, and horizons. iv) The statistical robustness of the reported gains is unclear. The paper does not report repeated-run statistics such as standard deviations or confidence intervals, which makes it difficult to assess the stability of the improvements
Questions for authors
i) Since the final objective is a weighted sum of two independently designed loss branches, it would be helpful to clarify what makes the overall framework fundamentally different from simpler multi-loss formulations. Can the authors clarify the framework-level novelty of HyOT? ii) Several components of HyOT, including Hyvärinen scoring, permutation patterns, and Plackett–Luce ranking, are based on established concepts. It would therefore be helpful to clarify how the proposed formulation differs from the most closely related prior methods. Can the authors better distinguish the novelty of HyOT from prior work? iii) The trajectory-specific metrics are evaluated only in a limited representative setting. Extending this analysis to more datasets, backbones, and forecasting horizons would provide stronger support for the main trajectory-aware claim. Can the authors provide a broader trajectory-specific evaluation? iv) The reported results are mainly presented as single point estimates without repeated-run statistics. Reporting results over multiple random seeds with standard deviations or confidence intervals would help assess the stability of the improvements. Can the authors provide such statistical results?
Dear Reviewer,
Thank you again for your valuable comments and feedback. As the rebuttal deadline is approaching, we would like to kindly follow up on our responses, in which we have addressed your questions and concerns.
We would greatly appreciate it if you could revisit our responses and consider whether they warrant an upward revision of your score. If you have any remaining questions or concerns, please do not hesitate to let us know. We would be more than happy to provide further clarification.
Thank you for your time and consideration.
Best regards, The Authors