- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
TopoAttn addresses medical time-series classification using separate channel and temporal representations, fixed training-derived spectral channel groups, local temporal neighborhoods, and hub-mediated communication. Temporal MoE embeddings and subject-context pooling complete the system. Five medical and two HAR datasets, component/topology comparisons, subject-level results and inference-access sensitivity provide evidence for the integrated configuration.
Critical strengths
S1. A coherent design incorporating distinct channel and temporal priors. TopoAttn combines training-derived spectral channel groups with local temporal neighborhoods in separate branches, using a shared hierarchical communication framework. The architecture provides an explicit, technically coherent way to encode these different interaction structures for medical time-series classification.
S2. Good reported gains over a close predecessor. Table 2 reports the highest mean performance in 27 of 30 medical dataset–metric comparisons, including comparisons with TeCh. These results support the empirical value of the integrated architecture.
Critical weaknesses
W1. The central TopoAttn contribution is insufficiently differentiated from close prior work. The first contribution emphasizes topology-aware local interactions and group-mediated global coordination (p.2, L69–87). RECTOR [1] already combines within-region local channel interactions, bidirectional channel–region exchange and global region attention for neural signals, but is not discussed. This overlap narrows the novelty of the general communication principle underlying TopoAttn, which is presented as the paper’s central methodological contribution.
W2. The topology comparisons do not fully isolate the benefits of TopoAttn’s specific design choices. The paper includes topology comparisons and group-count sensitivity analyses, but the FFT/prior comparisons change channel-group and therefore hub counts on PTB (8/3) and PTB-XL (4/2) (Table 6; A.5). The APAVA group-count sensitivity analysis (Table 11) does not resolve this confound. The random-control descriptions do not explicitly establish whether group sizes and permitted attention-connection counts are preserved (A.9.1–A.9.2). Moreover, the reported ablations do not isolate the additional benefit of hub–hub communication while retaining the global aggregation already provided by the sample core (§3.4; A.4.2, Eq.5). These comparisons support useful configurations more clearly than they establish the benefits attributable to particular grouping and communication choices.
References
[1] Jinhan Liu et al. RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation Learning. Proceedings of the 43rd International Conference on Machine Learning (ICML), PMLR 306:78389–78415, 2026.
Questions for authors
Q1. Given that TopoAttn is presented as the central methodological contribution, what advance does it provide relative to RECTOR? Please clarify how TopoAttn’s specific mechanisms differ from the shared principle of local interactions and group-mediated global communication, and identify what is new or informative in its design or empirical findings.
Q2. Does random channel grouping preserve the FFT partition’s group sizes and hub count, and does random temporal topology preserve the relevant connection counts or degrees? What evidence separates group membership from changes in the interaction budget in the FFT/prior comparisons? Please also clarify which hub operations remain in the dense variants and whether any comparison isolates hub–hub communication while retaining the sample core and other components. If existing controls do not isolate these effects, a targeted comparison would help.
Q3. Table 13 specifies two-sided t-tests at (). What observations enter each test, and are the tests paired or unpaired? How is dependence from repeated evaluation of the same subjects across seeds and overlapping training sets across folds addressed? Please clarify which sources of uncertainty these tests quantify.
Q4. Given the same-subject context and the independent-inference analysis in Table 14, which comparative conclusions extend to independent-sample inference? Please confirm that the retrained w/o Sub variant removes cross-recording enhancement during both training and inference while retaining within-sample cores. Please specify the input context available to TeCh and Medformer and their per-dataset numerical configurations and hyperparameter-selection procedures.
Q5. A.1 describes channel shuffling during training. How are these permutations handled in the channel-topology masks and positional encodings? When constructing and applying cached subject cores, how is correspondence between channel tokens across samples maintained?
6 comments
Response to Reviewer nfwv (2/2)
4. Per-sample inference and baseline settings [Q4]
-
We have updated per-sample inference results for TopoAttn (Table A) and completed the comparison of TopoAttn under two inference protocols for all MedTS datasets (Table C). The results support that the main conclusion extends to per-sample inference: TopoAttn achieves the best result in 22/30 evaluation metrics, and its performance changes only marginally from subject-enhanced inference on datasets with sufficient samples per subject. We confirm that w/o Sub ablation only removes the cross-recording enhancement in both training and inference.
-
We now ensure that all methods receive the same input under each protocol. Under per-sample inference, every method receives only the single input sample (Table A); under subject-enhanced inference, all methods receive the same subject core as TopoAttn in both training and inference (Table B). All baselines use the optimal hyperparameters of their official implementations, and the checkpoint with the best validation F1 is used for testing. The per-dataset configurations of TeCh and TopoAttn are listed below.
Table. Training configurations and model sizes of TeCh and TopoAttn. B: batch size; D: feature dimension; Nt/Nc: numbers of temporal/channel layers (0: branch disabled); Emax: maximum epochs; PT: early-stopping patience.
| Dataset | Model | B | D | Nt | Nc | Emax | PT |
|---|---|---|---|---|---|---|---|
| ADFTD | TeCh | 128 | 128 | 6 | 6 | 6 | 6 |
| TopoAttn | 128 | 128 | 6 | 6 | 6 | 6 | |
| APAVA | TeCh | 128 | 256 | 6 | 6 | 40 | 20 |
| TopoAttn | 128 | 256 | 6 | 6 | 40 | 20 | |
| TDBrain | TeCh | 128 | 128 | 6 | 0 | 60 | 60 |
| TopoAttn | 128 | 128 | 3 | 1 | 60 | 60 | |
| PTB | TeCh | 128 | 256 | 0 | 3 | 80 | 40 |
| TopoAttn | 128 | 256 | 3 | 3 | 80 | 40 | |
| PTB-XL | TeCh | 128 | 128 | 5 | 0 | 20 | 20 |
| TopoAttn | 256 | 128 | 5 | 1 | 20 | 20 |
5. Channel shuffling and token correspondence [Q5]
-
Topology masks and positional encodings. Channel shuffling is a training-only augmentation that permutes entire channels before tokenization, following Medformer and TeCh (Appendix A.1); positional encodings are added afterwards. Since channels are grouped by the FFT profile of the entire channel signal (Section 3.3), which shuffling leaves unchanged, each channel keeps its group after permutation, and the topology masks are unaffected.
-
Correspondence in subject cores. The subject core is built right after token embedding. For each anchor sample, we aggregate all samples with the same subject ID only once using Eq. 5 (Section 3.4). The aggregation is performed at each token position, so each core token corresponds to the same channel in all samples. The subject core is then concatenated to the anchor sample to form the enhanced sample. After that, each encoder layer performs only sample-level aggregation within the enhanced sample.
I thank the authors for the detailed response and revision. The clarifications concerning inference protocols (Q4), together with the additional controls and portability experiments (Q2), address several of my earlier concerns.
My principal concern remains the distinct contribution, alongside several questions about interpreting the results.
1. Novelty and scope (W1/Q1). The response acknowledges that TopoAttn shares the general principle of local interaction with group-mediated global communication. Related principles appear in local-plus-global token attention (Longformer, BigBird), core aggregation–redistribution (SOFTS, TeCh), and region-level channel interaction with global region attention (RECTOR). The dual tokenization and core module also build on TeCh and SOFTS. The differences from RECTOR (data-driven rather than anatomical groups, and local rather than dense temporal attention) clarify the design, but do not by themselves establish the significance of the methodological advance.
The distinctive contribution therefore appears to lie primarily in the specific topology construction: FFT-similarity channel clustering and sliding-window masks with segment hubs. Contribution (1), however, also emphasizes the hierarchical communication mechanism, whose incremental benefit remains insufficiently isolated:
- As the response confirms, the w/o Topology ablation removes the masks and hubs together while retaining the sample core, which already performs global aggregation. It therefore does not separately establish the benefit of the hubs or hub–hub communication. A focused control removing the hubs, or only the hub–hub attention, would clarify this.
- The interaction counts in A.6 support theoretical savings, but their practical benefit remains unclear without a matched runtime and memory comparison against w/o Topology.
Please distinguish the proposed topology construction from the communication principles inherited from prior work, and align contribution (1) with the evidence. I acknowledge the empirical improvements, but remain uncertain whether they establish a sufficiently distinct methodological advance.
2. Variability and statistical tests (Q3). Please clarify what the reported standard deviations measure (e.g., APAVA accuracy ±0.24, Table 3), and provide:
- the 25 individual run scores;
- the fold/seed averaging order;
- the observations entering each Welch test.
In particular, please distinguish variability across seeds from variability across held-out subjects or folds. Since all seeds reuse the same fold assignment, please account for pairing and dependence among runs, for example with a paired fold-level or corrected resampled t-test.
3. Channel shuffling (Q5). Permuting channel order preserves each channel's FFT profile, but changes its positional index. Please explain how correspondence among the shuffled inputs, topology masks, and subject-core tokens is maintained, including:
- whether the masks are permuted or recomputed;
- whether cached cores use augmented or unaugmented samples;
- how each shuffled input is aligned with its core.
The description in A.1 does not yet make this clear. Any misalignment could affect the interpretation of both the topology and the subject-enhancement results.
4. TeCh+Topology configuration. The supplied TeCh configurations disable the channel branch on TDBrain and PTB-XL and the temporal branch on PTB. Please report the branch and layer settings of TeCh+Topology, state whether they match TeCh's, and include the experiment and its configuration in the manuscript. This is needed to attribute the reported gains to the topology addition.
The revision strengthens the experimental evidence, and I credit the matched protocols, random controls, TeCh+Topology results and PTB-XL per-sample evidence. My main reservation remains the distinct contribution, with the questions above limiting the interpretation of some results. I therefore maintain my current score of 2. Focused clarification and evidence addressing these points would strengthen the case and prompt me to reassess the rating.
Response to Reviewer nfwv (1/2)
We thank the reviewer for the constructive comments. Related points are grouped and answered below. Tables A-C are provided in the General Response to Reviewers.
1. Difference from RECTOR [W1, Q1]
We now cite RECTOR in Related Work (Section 2). Both models share the general structure of local interaction with group communication, but differ in two essential aspects:
RECTOR has no public implementation, so an empirical comparison is not feasible in our rebuttal.
2. Isolating the benefits of Topology [W2, Q2]
Random and domain-prior controls. The random topologies differ from TopoAttn only in group membership, with identical group number, group sizes, hub count, and permitted connections, and thus isolate the effect of the topology from the interaction budget. The domain-prior topology follows fixed anatomical groupings, so its group count can differ from that of TopoAttn. TopoAttn outperforms both controls in all dataset-metric comparisons (Tables 10 and 11).
Hub operations. In w/o Topology ablation study, we directly replace the topology-aware sparse attention with dense attention in both channel and temporal branches, so no hub structure remains. All other components, including subject-guided aggregation module (subject and sample core) are kept unchanged. TopoAttn outperforms this w/o Topology variant on all MedTS datasets (Table 4). We also add an experiment that equips TeCh with our topology-aware sparse attention structure. The results also show consistent improvements on all MedTS datasets (See the Table below).
Table. F1 of TeCh equipped with the channel and temporal topologies of TopoAttn (TeCh+Topology) under subject-enhanced inference. Best in bold.
3. Significance tests [Q3]
[Corrected on 18 Nov 2026; see our follow-up response.] We have updated the description of the significance tests under two inference protocols (Tables 14 and 15). Each test compares the five seed-level averages (each over the five folds) of TopoAttn and TeCh for one dataset and metric using an unpaired two-sided Welch's t-test, and therefore reflects variability across training seeds. Variability across held-out subjects is analyzed with a paired fold-level test in our follow-up response and in Appendix A.11.