- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
The paper proposes BIC, a three-stage pipeline for explainable badminton-stroke coaching from multimodal wearable sensors (skeleton IMUs, EMG, plantar pressure, and eye gaze). Experiments on backhand drive and forehand clear strokes from MultiSenseBadminton cover three evaluations: skill-level discrimination (expert vs. beginner AUROC), phase-level anomaly localization, and an expert-adjudicated assessment of coaching findings and report quality. BIC reports large improvements over TSAD baselines, ChainBMD, and a generalist MLLM. Overall, this paper is well written but also raises some concerns.
Critical strengths
Framing coaching as “detect deviations first, then judge” is intuitive. It aligns better with how human coaches give feedback than the classify-then-attribute pipelines used in prior work. Structuring cross-modal fusion around a biomechanical body-part–sensor graph is a sensible way to inject domain priors, and the ablations support it: graph versus flattened skeleton, and modality-specific versus global denoiser. The pipeline is complete and well engineered. It connects low-level signal anomalies to rule-verified, human-readable coaching output, and grounding findings in deterministic rule checks is a reasonable attempt to limit LLM hallucination. The paper includes a human expert study with per-finding adjudication rather than only aggregate Likert ratings, and the appendix gives extensive implementation details, including full prompts.
Critical weaknesses
-
The introduction frames AI coaching as a scalable alternative to human coaches reviewing every repetition. However, the proposed system relies on a lab-grade setup: 21 IMUs, three EMG sites, bilateral pressure insoles, and an eye tracker. This is far from deployable in routine training, so the scalability argument does not hold. The paper also stresses that the decisive signals (muscle activation, plantar pressure) are invisible to the naked eye. Yet the ground truth for coaching correctness comes from experts judging footage, skeletal video, and reports (Sec. 4.3, App. K.2). It is unclear how experts could reliably adjudicate findings such as elevated forearm activation or heel-weighted loading. If they cannot, the evaluation does not test the signals the paper claims are essential. I feel like the authors should elaborate more on the "motivation" part or the logic of the research gap.
-
The differentiation from ChainBMD (modeling the non-racket side, avoiding template outputs) is an engineering difference rather than a conceptual gap. Methodologically, the pipeline combines established components (ST-GCN, TCN, latent DDPM, an LLM-drafted KG, and an MLLM). The paper does not offer an insight that transfers beyond this application. The title and abstract emphasize explainable, traceable coaching, but no experiment measures traceability. The Level-2 causal and correlational edges are drafted by an LLM. Their correctness is never validated, for example, by expert agreement on the edges or on the generated explanation chains.
-
The prompt in App. F.2 describes it as a corroboration mechanism that raises or lowers confidence. Sec. 3.4, however, states that traversing it triggers no additional evaluation. Please clarify which is the case.
-
Each fold trains on two experts and tests one expert against eight beginners. The model may learn subject identity (anthropometrics, sensor placement) rather than skill. Strokes from the same subject are not independent, and no subject-level results or statistical tests are given. Excluding intermediate players because of class overlap simplifies the task. The results only show separation of the two extremes, not skill grading.
-
Sampling rate, rationale for the 3+3-frame window, number of diffusion samples used for scoring, score variance, and the phase segmentation procedure are not given.
Questions for authors
-
λ3 appears twice in L_total, could you briefly explain the reason in the main text?
-
How did experts verify findings that depend on EMG or plantar pressure using footage, skeletal video, and reports? What fraction of BIC’s findings involve these modalities, and how were they rated?
-
What are the results for a baseline of MLLM + matched expert reference + TSAD hints, without the KG and rules?
-
Can you report subject-level AUROC with statistical tests, and show that the model is not separating subjects by identity?
-
Did the baselines use the same windowing, normalization, and pretrained encoders as BIC? What explains the below-chance scores?
-
Could you please explain the 1/(|M_sens|−1) normalization in the main text?
10 comments
Response to Reviewer NZt2 (Part 2)
W2(b): Transfer beyond badminton coaching.
We thank the reviewer for asking how BIC’s design might apply beyond badminton. BIC illustrates two transferable design principles for explainable multimodal time-series analysis. First, anomaly detection can incorporate domain-defined relationships between heterogeneous measurements instead of treating their channels independently. Second, deterministic rule verification can connect learned anomaly signals to interpretable findings before language-model-based discovery. These principles may be applicable to other sensor-based movement assessment tasks, and their generalization are worth exploring.
W1(b) and Q2: How were findings involving non-visible sensor modalities evaluated?
(1) Evaluation protocol (Appendix I.3).
Before evaluation, all four badminton experts were introduced to the sensing modalities, including what each sensor measures and how to interpret its visualizations. For each finding, they received player-versus-matched-expert sensor plots corresponding to the cited body region, alongside player video and skeleton playback. The plots were aligned with stroke phases, allowing experts to assess whether the reported biomechanical error was supported by the measured signals during the relevant phase.
We added Figure 18 in Appendix I.3 to illustrate this procedure using an insole-related finding. It compares the player's plantar-pressure distributions with those of the matched expert, with stroke phases annotated and the impact frame highlighted. Reports were anonymized and randomized, and TSAD annotations were hidden.
(2) Expert judgments across modalities (Appendix I.8).
We further report the distribution of expert verdicts for BIC findings by supporting modality:
| Evidence modality | Share | Agree | Not sure | Disagree |
|---|---|---|---|---|
| Skeleton | 31.0% | 95.7% | 0.9% | 3.4% |
| EMG | 21.9% | 86.6% | 3.0% | 10.4% |
| Plantar pressure | 38.0% | 83.7% | 4.1% | 12.2% |
| Gaze | 9.1% | 64.4% | 11.8% | 23.8% |
EMG and plantar-pressure evidence together account for 59.9% of BIC findings. Among expert verdicts, 86.6% for EMG and 83.7% for plantar pressure are positive, demonstrating that experts frequently supported findings based on these non-visible measurements.
Response to Reviewer NZt2 (Part 3)
W2(c, d) and W3: Traceability, KG auditing and validation, and the role of Level-2 relationships.
(1) Quantitative evaluation of traceability (Appendix G.5).
We introduce a traceability analysis in Appendix G.5 of the revised manuscript. A finding is considered rule-verified when it can be traced through an identified anomaly location, a matched Level-1 coaching rule, and a deterministic measurement evaluated against an explicit acceptance threshold. This establishes a measurable evidence path from sensor observations to the reported coaching error.
| Stroke type | Rule-verified (83.4%) | Stage 3 (16.6%) |
|---|---|---|
| Backhand | 87.1% | 78.3% |
| Forehand | 92.4% | 97.8% |
| All strokes | 91.4% | 91.3% |
From the above table, across all BIC findings, 83.4% are rule-verified, while the remaining 16.6% originate from Stage-3 MLLM discovery. The two groups achieve comparable expert acceptance rates of 91.4% and 91.3%, respectively. These results quantify the coverage of deterministic verification while demonstrating the complementary role of MLLM-based discovery.
(2) Expert auditing of the knowledge graphs (Appendix G.4).
Both KGs are initially drafted by an LLM but undergo expert review before deployment (Appendix G). Three badminton experts examined the coaching rules and biomechanical relationships, correcting, removing, or adding entries where necessary. These auditors are distinct from the four experts evaluating coaching reports. They reviewed and edited a shared KG individually without direct communication. All revisions were visible to the other auditors, who could retain or further revise previously edited entries. Thus, the auditing process involved iterative expert refinement rather than independent blinded annotation or formal consensus voting. Consequently, inter-auditor agreement was not measured. We added the following audit statistics in Appendix G.4:
| Graph element | Drafted | Edited | Removed | Added | Final |
|---|---|---|---|---|---|
| Level-1 rules | 182 | 39 | 20 | 2 | 164 |
| Level-2 edges | 296 | 69 | 14 | 1 | 283 |
As such, the deployed KG is not used directly from LLM generation but is refined through domain-expert auditing.
(3) Expert evaluation of instantiated Level-2 explanations (Appendix G.6).
We also conducted an additional blinded evaluation of Level-2 relationships instantiated across 20 randomly selected strokes (10 backhand and 10 forehand) from the set that contains at least two expert-accepted findings and one relationship from both systems. In total there are 79 relationships. For each relationship, two badminton experts assess its biomechanical correctness using the connected findings and player-versus-expert multimodal visualizations.
Experts confirmed the biomechanical correctness of 69/79 relationships (87.3%), with 10 uncertain and none disagree. Agreement between raters reached 91.1% (72/79).
(4) Clarification of Level-2 inference.
We apologize for the ambiguity in Appendix F.2. The Level-2 KG serves an explanatory rather than a confidence-scoring function. After Level-1 deterministic evaluators verify individual errors, Level 2 connects them through expert-reviewed causal and correlational relationships to construct explanation chains. It does not modify detection confidence or validate additional errors.
The confidence-adjustment part in Appendix F.2 is intended to provide the LLM with the task context and explain the concept of biomechanical corroboration. It guides the LLM in constructing meaningful biomechanical relationships, rather than specifying an implemented confidence-update mechanism. During inference, Level 2 is used solely to organize already verified errors into explanatory chains, consistent with Section 3.4.
Response to Reviewer NZt2 (Part 1)
Thank you for the detailed assessment and for recognizing the motivation for detecting deviations before assigning coaching interpretations. We address the scope, empirical grounding, and reproducibility questions below.
W1(a, c): Motivation, scalability, and research gap.
We appreciate the reviewer's concern regarding the practical deployment of a system requiring multiple wearable sensors. We acknowledge that the current sensing setup is resource-intensive and limits its immediate applicability to routine training.
However, our primary objective is not to develop a consumer-ready sensing system, but to investigate how heterogeneous biomechanical measurements can be automatically interpreted to provide accurate, explainable coaching feedback.
This sensing setup is motivated by the nature of badminton execution. Video and skeletal motion reveal joint kinematics, but cannot directly measure muscle activation, plantar-pressure distribution, or gaze behavior. These signals provide complementary evidence about muscle recruitment, weight transfer, and visual attention, which are relevant to coordinated stroke execution. Consequently, errors involving these measurements may remain undetected through visual inspection alone, limiting the specificity of corrective feedback.
The central research gap is therefore not simply the lack of sensing modalities, but the absence of a systematic approach to localize multimodal execution deviations, verify their biomechanical significance, and translate them into actionable coaching errors. BIC addresses this through biomechanically structured anomaly detection and knowledge-guided error verification. We agree that reducing sensor requirements is important for practical deployment. The present work establishes the modeling and diagnostic framework using the available synchronized multimodal measurements.
We have also revised the Introduction to explicitly acknowledge the deployment limitations imposed by specialized wearable sensors.
W2(a): Methodological contribution beyond ChainBMD.
We appreciate the reviewer's observation that BIC builds upon established neural architectures. Our contribution lies in how multimodal anomaly detection and biomechanical knowledge are integrated to perform error-level diagnosis, rather than introducing a new standalone neural backbone.
(1) From skill-level attribution to error-level diagnosis.
ChainBMD first predicts a player's skill level and then attributes the prediction to body regions before mapping them to coaching errors. However, a body region associated with a skill prediction does not necessarily identify which biomechanical rule was violated, when the violation occurred, or what measurement supports the diagnosis. BIC instead directly models expert execution and identifies localized deviations. These observations are mapped to candidate biomechanical rules, which are subsequently verified against measurable sensor-derived features and expert-calibrated thresholds. Thus, coaching errors are established through explicit biomechanical evaluation rather than inferred from skill-classification attribution.
(2) Biomechanically conditioned anomaly modeling.
The contribution is not the use of a graph itself, but how biomechanical relationships are incorporated into the definition of abnormal execution. In multimodal sports data, individual sensor signals may appear plausible in isolation while their coordination across body parts is inconsistent with expert execution. BIC addresses this by conditioning future-signal reconstruction on anatomically related modalities, using local-global contexts and cross-modal consistency learning. Consequently, anomaly detection considers both modality-specific deviations and their relationships with other biomechanical measurements.
(3) Knowledge-guided verification and discovery.
BIC combines deterministic rule verification with MLLM-based discovery of errors beyond the predefined rule catalog. Removing KG-based verification reduces coaching F1 from 0.728 to 0.432 on the common ablation reference pool (Section 4.4, and the answer to Q3 below), demonstrating its substantial contribution to reliable error identification.
Therefore, BIC's contribution extends beyond combining existing components. It reformulates coaching from skill-level attribution to error-level diagnosis, incorporates biomechanical dependencies into multimodal anomaly detection, and verifies identified errors against measurable evidence. Together, these mechanisms provide a systematic framework for producing localized, evidence-grounded coaching feedback, with their effectiveness supported by the component ablations.