- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
the goal is to model cognitive and linguistic speech markers to improve early versus late MCI staging across languages.
Critical strengths
Clinically meaningful problem
Hierarchical but not flat modeling
Potential for interpretability
Critical weaknesses
The method is incremental. It combines BERT layers grouped into stages, marker-query cross attention, concatenated summaries, and extracted markers.
No ablation on the hierarchy itself. So the claimed benefit of "hierarchical" modeling is unclear.
Missing baselines: e.g., CogniVoice https://arxiv.org/abs/2407.13660 (Interspeech 2024) is a multimodal and multilingual model tested on the same TAUKADIAL data.
The eMCI/lMCI labels are not clinical. They come automatically created using only age, sex, and MMSE, so the model may be learning a proxy for those variables.
no confidence intervals, seeds, or significance tests.
poor metric choice for imbalanced test data.. use AUC-PRC instead, see this paper for details: https://ftp.cs.wisc.edu/machine-learning/shavlik-group/davis.icml06.pdf
Evaluation covers only one task and one condition.
Questions for authors
see above.