- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
HALO studies the task of human action recognition (HAR) from wearable sensors and the generalizability (cross-subject, cross-position, cross-dataset) of the learned feature representation. HALO offers two simple yet effective designs: (1) it hypothesizes that simple hand-crafted motion statistics are more stable cross-domain representations, and encodes each handcrafted statistical anchor with a network-learned feature correction. (2) it proposes HARCauKer for neural-part pretraining, a synthetic motion environment with physically coupled inertial rendering. It is tailored for IMU HAR. It constructs a thorough cross-domain generalization benchmark, and HALO outperforms the general-purpose time-series baseline MantisV2 and various IMU-based methods.
Critical strengths
1. The paper is well-written, well-motivated and clearly highlights the challenges.
2. It provides a thorough generalization benchmark for cross-domain HAR and clear reproduction details.
3. It uses constrained features based on simple hand-crafted features and designs simulation training tailored for IMU HAR. The results outperform the general-purpose time-series foundation model MantisV2, particularly in cross-position and cross-dataset settings.
Critical weaknesses
1. A random set of 128 hand-crafted features is selected from the 10,098 candidates: Why not use all hand-crafted features? I understand this already proves that hand-crafted statistics can be more stable across domains and can reduce latency. It is similar to using a random mask on all hand-crafted features. Is it possible to adaptively find the optimal selection of hand-crafted features from all candidates? A more detailed discussion of hand-crafted features can benefit future research.
2. The L_factor reconstructs 10 standardized simulator targets, but their definitions are not clearly shown, nor is how these simulator targets contribute to the final synthesized data. This limits the reproducibility and the justification of whether the simulator is reasonable.
3. Since (\rho = 1) achieves the best cross-position and cross-dataset performance, it is a fixed hyperparameter rather than being adaptively determined. Why do the authors refer to this mechanism as a "Controlled Departure"? What additional benefits does this explicit norm constraint provide compared to standard feature addition?
Questions for authors
No
4 comments
Simulator factors
Thank you for asking how these factors help train HALO. HAR-CauKer first generates motion and then renders the corresponding IMU signals using orientation and gravity (Section 3.3 and Appendix B, Eq. 5). From each generated example, we compute ten known properties, such as rhythm, turning, tilt, and graph depth. These serve as additional training targets for the encoder, helping it capture motion information even when sensor conditions change. Importantly, they do not affect how the synthetic IMU signals are generated.
We also checked how much this training objective helps. Removing the factor loss reduces cross-dataset macro-F1 by 0.86 points, while removing the variation in sensor conditions leads to a larger drop of 4.82 points (Table 13).
Your question helped us realize that this distinction was not clear enough in the paper. We have added Figure 2 to illustrate the process, and the anonymous Research Story gives a fuller illustrated explanation. We will add the exact formulas and scaling to Appendix B to make the process easier to reproduce.
Radius control
The radius gives us a simple way to adjust how much HALO can move away from its statistical anchor. For each IMU window, the network proposes a correction, and the radius limits its size to ρ||a(x)||₂ without changing its direction (Eq. 3). We train HALO with ρ=1, but we can also try different radii with the same frozen encoder, without retraining it.
We tested how this affects performance. For cross-subject transfer, reducing the radius to ρ=0.2 improves macro-F1 from 83.4 to 84.4. For cross-position and cross-dataset transfer, increasing it to ρ=10 gives 59.1/66.5, compared with 58.8/65.7 at ρ=1 (Table 4). We also trained a separate model without any bound, which performed 6.7/5.2 points worse on these two transfers (Table 3).
So when we say the correction is "controlled," we simply mean that we can set a clear limit on how far the representation moves from its anchor. The results also suggest that this flexibility can be useful for different types of domain shift.
Thank you again for taking the time to go through these questions with us. They helped us see where our explanation could be clearer.
Official Comment of Reviewer QMN4
Thank you for the detailed responses and additional clarification and experiments. Most of my concerns are answered and I will lean to maintain my original score.
Thank you for taking the time to follow up. We’re glad our responses addressed most of your concerns, and we sincerely appreciate your thoughtful review.
Thank you for recognizing the value of our transfer tests and IMU-specific simulation. Your point that clearer feature descriptions could help future research is well taken. We have shared an anonymous code release and an anonymous Research Story, and will also make the related paper sections clearer.
Feature choice
Why not use all 10,098 candidates? The main reason is model size. Using all 10,098 statistics in our current correction network would make the final layer alone have over 100 million weights (Appendix B). So we randomly selected 128 features using seed 0 and kept the same selection across all datasets. We also wanted to check whether this choice would affect the results. We tried 64, 128, and 256 features, as well as five different random selections of 128 features. In every setting, HALO improved over its corresponding anchor (Appendix C, Tables 14 and 15).
Could we choose the 128 features adaptively? We think this is a promising direction. For this study, we wanted to understand how well a single, fixed anchor could work across different datasets, so we kept the feature selection unchanged. But we agree that some features may be more useful than others, depending on the setting.
To explore this, we ran an additional ablation looking at different groups of IMU features. We found that rotation-invariant features alone achieved 48.13 cross-position macro-F1, quite close to 49.12 with the full anchor. Meanwhile, axis-specific and pairwise-Gram features achieved 82.90 cross-subject macro-F1, compared with 83.88 for the full anchor.
This gives us a better idea of what an adaptive selector might look for. Different feature groups seem to capture complementary information, and their usefulness can depend on the type of domain shift. We could use this insight to choose a more suitable anchor while still letting HALO learn a bounded correction around it.
Thank you for raising this question. It helped us take a closer look at the feature selection, and we will include these additional results and discussion in the revision.