- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The manuscript aims for the interpretability for freezing of gait (FoG) detection. It involves a mult-scale Transformer for FoG detection with wearable signals. An SAE is used to analyze the model's internal states, and nine human-understandable movement concepts are identified with observations such as gait initiation, rhythmic bilateral gait and tremblinginplace. Clinical experts were able to recognize 88.9% of the identified concepts, and an F1 score of 94.2% for FoG detection was achieved.
Critical strengths
- This is a reasonble framework for analyzing FoG events. Some findings demonstrate some common FoG gaiting patterns during the clinical observation, which indicate the modeling itself learns critical patterns for prediction.
- Clinicians are involved into this study to very the findings. And the main results seem to be consistent statistically.
Critical weaknesses
- My main concern is regarding the findings, which can be trivial. The discovered concepts do not really reveal something new. They are established FoG gait patterns that have been recognized by the domain already.
- The clinical significance is not enough. The work mainly discover the concepts relevant to the anchor points. Yet, this is post-hoc. The explaniability in this study may not be able to uitlize for a deeper step: pre-alarming of FoG event.
Questions for authors
Besides the weaknesses part, I have the following questions/comments.
- As the authors mentioned, 'representative, clearly observable features' are dopted for this study. I thought these are more relevant to some common knowledge/concepts to the FoG gait understanding. Yet, the remaining hints may be more critical and insightful. I was wondering any observations from this part that provides some new knowledge. I understand the authors mention this as an limitation of the current work. But this can be important to reveal real new insights to the community.
- The current participants involved in this study seems to be not many. I was wondering about the representativeness of the population.
- Some fundamental causes of the FoG pattern might not be explaniable if with motion sensors only. My understanding is that the FoG happens with some particular scenarios, like the motivation to design the TUG test protocol (with the visual hints). It can be relevant to the environment while the proposed framework is not able to discover.
- There are various architectures for human motion understanding including the FoG recognition. Many different modalities are invovled. This proposed framework may not be able to used in a broader range of methods.
5 comments
Response to Q4: We added several experiments to test whether FoGConcept depends on the specific model configuration used in the primary study. In summary, our FoGConcept pipeline can be applied to different datasets, input windows and model backbones, and result in a similar concept set as the primary study (please see full analysis in response to reviewer 5XPz Q1 and Q2). These results show that FoGConcept is not tied to one model. At the framework level, FoGConcept operates on the learned representation of a FoG detector, regardless of its architectures. It decomposes that representation into sparse features, identifies features that functionally affect the detector through steering, and characterizes the movement patterns associated with those features. The procedure therefore does not rely on a particular feature index, model, or a fixed concept dictionary, and can be applied to any FoG detection methods. For different sensing modalities or placements, we do not expect identical concepts because the observable information itself changes. For example, bilateral ankle IMUs directly expose left- and right-foot motion, whereas wrist sensors cannot represent foot motions in the same way. Our FoG-STAR lower-back analysis confirms this boundary, that the pipeline remains applicable, but the resulting concept vocabulary reflects the information available at that placement. We therefore frame FoGConcept as a reproducible interpretability framework for learned wearable-sensor representations, with broader evaluation across architectures and multimodal sensing as an important future direction.
Dear Reviewer eJ3J,
We would like to thank you for taking the time to review our paper and for your insightful comments. We have addressed all the comments and suggestions you made. In particular, we clarified that our contribution is not to propose new clinical gait categories, but to provide a reproducible interpretability pipeline that reveals clinically recognizable movement concepts learned by a black-box FoG detector without concept-level supervision. We also substantially expanded the evaluation in response to your concerns about representative population and generalizability. In addition, we clarified the clinical role of the framework, the distinction between movement-level interpretation and causal explanation of FoG, and the potential extension to multimodal and pre-FoG settings. As we are approaching the end of the discussion period, please kindly let us know if you have any additional concerns. We truly appreciate this opportunity to improve our work and would be most grateful for any feedback you could give to us. If you do not have further questions, we are curious if you could consider raising our score. Thank you very much!
Response to Weakness 1 & Q1: Our goal is not to invent new clinical gait categories. In fact, requiring the discovered concepts to be unfamiliar or clinically novel would work against the purpose of interpretability as unfamiliar or newly invented concepts would make the model harder for clinicians/patients to interpret. The objective is to determine whether a black-box FoG detector internally represents movement structure that humans can recognize and clinically interpret. The nine reported concepts are therefore meaningful precisely because they emerge from the model without being predefined, labeled, or supervised as concepts, yet align with recognizable gait phenomena such as gait initiation, shuffling, trembling in place, and turning. Therefore, the correspondence with established FoG phenomena is itself evidence supporting the explanation. It shows that these clinically recognizable movement patterns are encoded as functionally relevant internal features that influence the detector’s FoG prediction. Our contribution is to propose a reproducible pipeline that uncovers and validates these concepts inside FoG detection models, not to propose a new clinical taxonomy of FoG.
Response to Weakness 2: The current paper is an interpretability study, and we do not view this as limiting its clinical relevance. Our goal is to identify which movement patterns a FoG detector relies on and make a previously black-box model understandable in clinically meaningful terms. The explanations themselves can provide clinically useful information. FoG is heterogeneous: patients may exhibit different manifestations, such as trembling in place or shuffling, and may freeze during different movement contexts such as gait initiation, ongoing walking, or turning. Identifying which concepts characterize an individual patient’s episodes could therefore support a patient-specific FoG profile, helping clinicians and caregivers understand how that patient tends to freeze and potentially informing more personalized management or intervention strategies. Our work provides the interpretable information needed for such patient-specific profiling and future personalized intervention. The same framework can also be extended to pre-FoG models for early-warning applications, and the underlying FoG detection model itself can be used for pre-FoG detection.
Response to Q2: We have now additionally repeated the complete FoGConcept analysis on a new dataset, FoG-STAR. All nine primary movement-concepts recur on the new dataset as well (full analysis in response to reviewer 5XZp, Q1). Collecting and annotating FoG data is challenging because FoG is intermittent, must be observed in people with Parkinson's disease, and requires extended expert reviews to obtain reliable labels. The study now evaluates 45 participants across two independent PD cohorts, which we believe provides a substantial basis for this type of clinically annotated FoG interpretability analysis and addresses the concern about reliance on a single cohort.
Response to Q3: FoG can also be influenced by environmental factors that are not directly observable from IMU signals. Our contribution is a reproducible interpretability pipeline for wearable FoG detection models, aimed at explaining how their learned sensor representations encode human-understandable movement patterns. In this setting, FoGConcept identifies which gait patterns, such as gait initiation, turning, shuffling, and trembling in place, are represented by the model and functionally contribute to its FoG decisions. This movement-level interpretation is important because IMU-based FoG detectors make their predictions from movement signals, yet their learned representations are difficult to understand. Our results show that these representations can be decomposed into recognizable movement concepts that recur across subjects and datasets and are functionally linked to model predictions. Environmental or cognitive mechanisms require models that additionally observe those sources of information, such as visual context or other multimodal signals. Extending FoGConcept to such multimodal models could reveal how movement concepts interact with environmental or contextual factors and is an important direction for future work. We will clarify in the revision that our present contribution explains the learned movement mechanisms of wearable FoG detection, and is not to provide a complete causal account of why FoG occurs.