- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies interpretable clinical gait analysis with vision-language models (VLMs). This paper proposes DrGait, a training-free harness framework for verifying VLM hypotheses with biomechanical tools. This paper reports higher classification accuracy and better report quality than direct VLM baselines on two clinical gait datasets.
Critical strengths
-
Good Motivation: VLMs often hallucinate geometric measurements in gait videos. Using the VLM as a planner and deterministic tools for measurement is a reasonable design.
-
Interpretable and Low-Cost: Each conclusion comes with tool-based evidence and a full reasoning trace. Human evaluators prefer DrGait reports in 73.4% of GAVD cases. DrGait with Gemini-3-Flash costs about the same as direct Gemini-3.1-Pro and performs better.
Critical weaknesses
-
Unreliable Results: (1) Sec. 4.4 reports 92.4%/51.4%, but Tables 1–2 report 93.2%/52.8%. (2) Sec. 4.5 says removing the dictionary drops 7.9%/19.5%, but Table 7 shows 11.5%/15.9%. (3) In Table 1, the baseline numbers match the class sizes (e.g., Gemini-3.1-Pro: 89/107=0.832 , 25/27=0.926 , 114/134=0.851). However, DrGait’s 99.3% specificity seems hard to obtain with 27 normal videos, and its 93.2% overall accuracy does not seem to match either. Please clarify these results again.
-
Limited Evidence for the Agentic Loop: (1) Triage-only already reaches 44.9% subtype accuracy, so most of the gain seems to come from the metrics and prompting. A baseline that gives the VLM the same metric text would help. (2) DrGait runs only 1.06 rounds on average, yet removing recursion drops accuracy by 8.9%. Please explain this gap.
Questions for authors
My main concern is unreliable numbers in this paper.
2 comments
Thanks for the response, but my concerns are not resolved.
First, attributing the inconsistencies to typos is not a convincing explanation. It instead reinforces my concern that the reported numbers are unreliable. I understand that the inconsistencies may come from mixing results across multiple versions of experiments. However, the final paper should be clear and consistent. Otherwise, it heavily confuses readers, such as me. I suggest revising the whole paper.
Second, the numbers in the response (96.3%, 92.5% and 51.4%) cannot be found in Tables 1 and 2. I have no idea where these numbers come from. And the response also does not explain how DrGait’s numbers in these tables were obtained. In Table 1, the baseline numbers match the class sizes (e.g., Gemini-3.1-Pro: 89/107=0.832, 25/27=0.926, 114/134=0.851). However, DrGait’s 99.3% specificity and 52.8% subtype accuracy cannot be obtained with 27 normal and 107 abnormal videos (26/27=96.3% or 27/27=100%; 56/107=52.3% or 57/107=53.3%). Therefore, DrGait’s numbers in Table 1 are not reliable.
So I will lower my rating to 1.
Dear reviewer,
As the rebuttal period is approach to the end, we would like to kindly check if our rebuttal has sufficiently addressed all your concerns and questions. Please feel free to let us know if any further clarifications, explanations or experiments are needed, and we will be more than happy to discuss further in any aspect.
Again, thank you so much for all your attention and efforts!