- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper adapts the Tiny Recursive Model (TRM) to multivariate time-series classification. The proposed model, RTSM, has three parts: a) a convolutional tokenizer: channel projection, gated depthwise convolutions, densely connected dilated convolutions, then strided patching; b) a single latent state y, refined by a shared 2-block attention/SwiGLU module with no positional encoding, using 3 cycles per step and 16 steps at inference; c) MambaSL-style weighted-pooling heads for the class and the halt signal. Training follows TRM: deep supervision, gradients only through the last cycle, Stablemax loss, a correctness-based halt head, and parameter EMA.
Under a validation-based protocol, which the authors introduce and use to re-evaluate 16 deep baselines, RTSM gets 72.81% mean accuracy over the 30 UEA datasets, against 71.21% for MambaSL. Under the original MambaSL protocol, which selects on the test set, it gets 80.82% against 79.82%. The ablations use 8 datasets and 3 seeds: a) the proposed tokenizer beats a plain Conv1D tokenizer; b) the single-state model beats the two-state variants; b) the full model beats the tokenizer alone (86.10% vs. 84.79%). An inference-time study shows that extra depth or stochastic breadth changes accuracy very little.
Critical strengths
I find a few points this paper has shown positively.
- The paper builds on TRM where it removes one of the two sates and empirically shows that their proposed model RTSM achieves better results (86.10 vs 84.29, tab 2).
- Another contri I see the proposed convolutional tokenizer: which combines channel projection, gated depthwise Conv1D, dense dilated Con1D, stried patch projection followed by layer norm. Empircally they show that the tokenizer-only trained model does poor job compared to full RTSM.
- Comparison with 30 benchmark dastets is commendable.
Critical weaknesses
The manuscript has several weaknesses are are listed below.
W1. The paper never shows that the recursion itself helps. a) Changing the training depth from 1 to 5 cycles gives 85.60–86.10%, which is within seed noise. b) Training with 1 supervision step instead of 16 costs only 0.12 points. c) At inference, running 64 steps instead of 1 adds about 0.4 points. d) Most of the gain comes from the tokenizer, which raises accuracy from 73.72% to 84.79%. The only evidence that refinement adds anything is the full model beating the tokenizer-only model by 1.31 points. But that baseline has no attention module at all. The gain could come from adding attention and not from recursion. A non-recursive transformer with the same tokenizer, is missing.
W2. Through deep supervision with per-sample trajectory accounting (Appendix A.1), each training sample can receive up to 16 optim updates per epoch. So RTSM’s 100 epochs is substantially more optimization than the baselines’ 100 epochs. RTSM also uses parameter EMA (Appendix C.2) and its own optimizer settings (Table 4), which the baselines do not get. The paper reports no parameter counts for the baselines or the tokenizer, and no FLOPs, training time or inference latency for any model.
W3. The 1.60-point lead over MambaSL (72.81% vs. 71.21%) is not "statistically significant". The one-sided Wilcoxon p-values against the next-best models are 0.238 (MambaSL), 0.087 (TSCMamba) and 0.123 (InterpGN) (Table 7). The 30-dataset benchmark also uses a single seed.
W4. The methodological novelty is limited: RTSM combines established components (a WaveNet/DenseNet-style convolutional tokenizer, a weight-tied attention block with input injection, MambaSL’s pooled readout) and, as Table 1 states, reuses TRM’s training recipe unchanged.
Questions for authors
See the weakness and suggested experiemnta/proofs.
3 comments
The authors have made substantial efforts to address my concerns through additional experiments, expanded evaluations, and clearer reporting. In particular, the new single-pass attention comparison is valuable because it separates the contribution of attention-based processing from that of repeated recursive refinement. The results indicate that most of the improvement over the tokenizer-only classifier comes from attention addition, while full RTSM provides only a marginal additional gain (). I appreciate that the authors have revised their claims accordingly rather than overstating the contribution of recursion. The expanded three-seed evaluation and Holm-corrected statistical tests also address my concerns about the reliability of the original single-seed comparison. The authors have appropriately refrained from claiming statistically significant superiority over the competing methods. The reporting of optimizer updates, parameter counts, training time, and GPU memory is also substantially improved. Nevertheless, the computational-efficiency claims remain limited because the experiments do not provide controlled inference-latency comparisons or matched computational budgets. Weight sharing establishes parameter efficiency with respect to refinement depth, but does not establish lower overall computational cost. My remaining reservation concerns methodological novelty. The revised manuscript provides a clearer account of the architectural adaptations and additional tokenizer ablations. However, the contribution remains primarily an integration and adaptation of established components. Furthermore, the marginal benefit of repeated refinement raises questions about the importance of the recursive component to the overall contribution. Overall, I appreciate the authors' constructive response and consider the revised manuscript substantially improved. The remaining concerns are primarily about the strength and positioning of the methodological contribution, rather than the adequacy of the newly reported experiments. I leave the final assessment of whether this level of architectural and empirical contribution meets the conference threshold to the area chair.
Follow-up: architectural contribution and manuscript revisions
Thank you for the careful reassessment and for recognizing the value of the expanded experiments. We understand that your remaining reservation concerns the significance of the architectural contribution. We have revised the Abstract, Introduction/contributions (Section 1) and Conclusion (Section 5) to explain the design findings and their implications more directly.
RTSM adapts recursive architectures to continuous temporal inputs and sequence-level classification through temporal encoding before patching, one token-aligned latent state, and pooled prediction. Table 1 and Section 3 distinguish these adaptations from the inherited TRM training recipe and MambaSL readout. The contribution combines this task-specific design with evidence about which architectural choices are useful.
Our work also connects to a line of time-series research that develops task-specific architectures from established components. For example, MambaSL (ICLR 2026) revisits the design of single-layer Mamba for time-series classification, while iTransformer (ICLR 2024) reorganizes standard Transformer components around variate representations for forecasting. We position RTSM at this architectural level: adapting recursive models to temporal classification and investigating how temporal encoding, latent-state organization, and refinement depth affect the resulting model. The expanded experiments make the resulting design findings and accuracy–cost tradeoffs explicit, as detailed below.
A useful single-pass configuration. Across all 30 datasets and three seeds, the temporal encoder with one application of the attention module reaches 72.47% mean accuracy, versus 68.27% for tokenizer-only classification and 72.62% for full RTSM. This separately trained variant identifies a strong shallow classifier within the adaptation. Section 4.2, Table 4, attributes the 4.20-point gain to the tested encoder-plus-attention configuration and reports the additional 0.15-point gain from full refinement separately. Seed-0 GH200 profiling gives a median dataset-paired full/single-pass batch-1 latency ratio of 24.87 across all 30 datasets (Appendix B.5, Table 24), quantifying the practical value of this simpler configuration.
A simpler recurrent state organization. On the common 20 additional completed datasets, single-state RTSM reaches 68.96%, versus 64.37% and 65.13% for the shared-network and separate-network two-state adaptations. Appendix B.3.2, Table 14, separates these new results from the original eight and combined 28 datasets. On this same 20-dataset subset, the two-state variants have median dataset-paired batch-1 latency ratios of 4.73 and 4.82 relative to single-state RTSM (seed-0 profiles; Appendix B.5.1, Table 25). State organization and refinement schedules both differ, so this supports the tested single-state configuration as a whole. The separate-network variant retains TRM training and is not a full HRM reproduction.
An encoder choice whose effect depends on the downstream model. Removing gated-block residual connections improves tokenizer-only accuracy by 1.05 points, but reduces single-pass accuracy from 72.47% to 70.83%. Section 4.2 and Appendix B.3.1, Table 13, show why encoder components should be evaluated together with their downstream processor. This is a concrete design finding beyond the aggregate benchmark result.
We agree with your distinction between parameter reuse and execution cost. Section 4.3 and the Conclusion preserve that distinction: weight tying keeps the refinement module's parameter count independent of depth, while full RTSM has higher recorded training cost than the three re-evaluated baselines. The additional 540-run matched-update comparison (Appendix B.2.1, Table 11) retains positive mean accuracy differences, with none significant after Holm correction. It controls update counts, not total computation. Appendix B.5 now reports inference latency and allocated memory with their scope: preloaded inputs, excluded feature generation, and effective TF32 settings that were not logged. The cross-model profiles do not establish matched arithmetic precision or end-to-end speed; incomplete custom-Mamba FLOP counts are not used to rank total compute.
The revised positioning therefore emphasizes what this adaptation makes possible and what its evaluation teaches: strong classification with temporal encoding and shallow attention, a useful single-state recurrent alternative, and a measured assessment of the extra refinement. We hope this makes the architectural and empirical contribution easier to assess.
Response to reviewer kGph
Thank you for separating architecture, recurrence and training effects. We added the single-pass comparison, expanded to three seeds, and revised the accuracy/efficiency claims.
W1: What repeated refinement contributes
The tokenizer-only control also removed attention. New, separately trained attention variants keep the tokenizer, readout and attention architecture fixed:
H is cycles per step and S the training step cap. Evaluation uses fixed S steps; both caps are explicitly one for single-pass attention. Entries are mean ± sample SD of three seed-level dataset-macro accuracies. Attention variants have equal parameter counts, but computation and updates differ.
Single-pass attention accounts for 4.20 of the 4.35-point gain over tokenizer-only; full RTSM adds 0.15 points, without a monotonic refinement benefit. The revised abstract, contributions, Section 4.2, Table 4 and conclusion distinguish architectural gains from the limited additional mean benefit of recurrence. This does not establish equivalence between variants.
Across 28 completed datasets, single-state RTSM reaches 73.85 ± 0.26%, versus 70.26 ± 1.18% and 70.60 ± 0.78% for shared-network and separate-network two-state variants. Table 12 separates the original eight from the additional 20 datasets. Both two-state variants failed with CUDA OOM on EigenWorms and StandWalkJump for all three seeds (12 runs); these datasets are excluded from the paired comparison. The separate-network variant retains TRM training, not the full HRM procedure.
W2: Training opportunity and resources
All new exports report 100 completed epochs, but RTSM counts adaptive trajectories with potentially multiple updates each. Equal epochs therefore do not establish equal training opportunity. Batch sizes and optimizer/EMA settings also differ.
RTSM makes more updates than MambaSL on 20/30 paired datasets despite its lower overall mean. We do not interpret the mean as less training opportunity. The one-step variants retain 72.47% mean accuracy without repeated supervision within a trajectory. They average 5,000 updates, exceeding MambaSL on 13 datasets, equalling it on seven and using fewer on ten.
Table 2, Section 4.3 and Appendix A.1 report GH200 resources at selected batch sizes. RTSM times training segments including scheduling/logging/EMA; baselines time minibatch updates after data retrieval. Both exclude validation/final testing. These differing scopes do not establish equal-batch inference speed. Weight tying avoids parameter growth with depth, but full RTSM has higher measured mean training cost. We removed speculative throughput claims.
W3: Seeds and statistical significance
The original mean lead did not establish significant superiority. The new all-30 results are RTSM 72.62 ± 0.10%, MambaSL 70.29 ± 0.76%, TSCMamba 69.86 ± 0.31%, and InterpGN 68.76 ± 1.24%. SDs describe the three seed-level macro scores, not confidence intervals.
On one three-seed mean per dataset, one-sided Wilcoxon p-values are 0.1791/0.0184/0.3133; Holm-adjusted values are 0.3581/0.0552/0.3581. None passes 5%. Appendix B.2 specifies the normal approximation, tie correction, exact-zero removal and no continuity correction; Tables 9-10 give tests and per-dataset results. Near-tie checks preserve the conclusion. Full RTSM remains primary.
On the 22 datasets outside early architecture development, mean accuracies are 67.75%, 66.80%, 65.90% and 64.95%, respectively. We report observed pipeline-level differences without claiming significant superiority. Section 4.1 and Appendix A.1 disclose that early design exploration used test feedback on eight datasets.
W4: Scope of novelty
The contribution is the adaptation to continuous temporal inputs and sequence-level classification: local temporal encoding before patching, a single token-aligned state repeatedly conditioned on the input, and pooled prediction. Table 1 and Section 3 distinguish these adaptations from the retained TRM training recipe and MambaSL readout. The expanded results support the temporal encoder, single-state organization and attention processing; further refinement adds little mean accuracy at greater training cost.
Anonymous code and configurations: https://anonymous.4open.science/r/RTSM-ICLR2027/