- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AdaSpecK for temporal domain generalization. It applies spectral filtering to domain-level feature trajectories, learns their evolution through a Koopman operator, and combines target-conditioned historical attention with environment-guided expert routing. Experiments on eight classification and regression benchmarks report improvements over existing TDG methods.
Critical strengths
-
The method combines environment evolution with sample-level prediction in a coherent overall framework. Modeling compact environment representations is a reasonable alternative to forecasting full model parameters.
-
Evaluation spans eight benchmarks and includes repeated runs and ablations.
Critical weaknesses
-
The novelty is limited. FreKoo (Yu et al., 2025) already addresses long-term evolution and domain-specific uncertainties through spectral decomposition and low-frequency Koopman modeling. AdaSpecK’s filtering, encoding–transition–decoding pipeline, and transition and reconstruction objectives substantially overlap with this design. The paper does not sufficiently establish a distinct contribution beyond FreKoo, and the incremental additions fall short of the novelty expected at ICLR.
-
Ordinary DFT over domain indices and a fixed transition do not explicitly account for unequal time intervals. Moreover, Eq. (10) appears to produce a single context embedding; if this supplies only one key/value to Eq. (12), attention becomes independent of the target query. The amplitude and phase in Eq. (13) are also undefined for the real-valued, inverse-transformed representation. These ambiguities prevent verification of the claimed irregular-time modeling and target-specific context extraction.
-
The ablations remove individual components but lack capacity-matched alternatives, such as a standard attention module or a single MLP replacing the experts. Performance across prediction horizons and controlled irregular-sampling settings would also help substantiate central claims.
-
The transition and consistency losses constrain observed trajectories but do not guarantee stable future rollouts. The paper provides neither theoretical conditions nor empirical analysis of the Koopman operator’s spectrum and error growth over longer horizons.
Questions for authors
-
What methodological contribution distinguishes the spectral–Koopman component from FreKoo beyond changing the modeled trajectory? Can controlled comparisons isolate the gains from environment-space modeling, historical attention, and spectral routing?
-
Where do the actual time intervals enter the spectral transform and Koopman transition? How does the RK4 solver mentioned in the appendix relate to Eq. (6)?
-
What is the shape of , and how many historical keys/values are used in Eq. (12)? Please also specify how amplitude and phase are computed and confirm that the environmental signature uses only historical information and predicted future states.