- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This study claims to contribute to evaluation methodology: it creates a six-dimension, five-status annotation taxonomy for narrative fidelity in clinical note generation and an empirical demonstration, across six generation systems and dialogues from ACI-Bench. The manuscript is poorly written and the contributions remain unclear.
Critical strengths
None
Critical weaknesses
"Clinical notes are usually evaluated as summaries, with ROUGE, BERTScore, or other overlap with a reference note. These metrics reward factual completeness..." ---> what do you mean? Is it true that ROUGE and BERTScore reward "factual completeness"?
Lacking detailed foundations and definitions of six-dimension, five-status annotation taxonomy
The data size is small, limiting its contribution: "a public corpus of 207 clinical dialogue–note pairs across three sub-collections (aci, virtassist, virtscribe)"
Questions for authors
Why six-dimension, five-status annotation taxonomy?
The study does not cite MED-OMIT, DocLens, TofuEval. It also did not cite Abacha et al, 2023 (Findings of ACL) and Asgari et al, npj Digital Medicine 2025.