- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces the COTCAgent framework for sequential diagnosis scenarios. The framework proposes a Temporal-Statistics Adapter (TSA) to convert the temporal data into typed evidence with verifiable named routines. This work uses a ternary representation of evidence, present, absent, and unknown, to better distinguish different states of the evidence. It treats the disease–evidence relationships as learnable weights to help identify more informative questions during multi-round consultations. This work also represents the chain of thought as an evidence scoring log, making each round of diagnosis traceable to entries in the knowledge base.
Critical strengths
-
This work addresses practical problems and has a clear motivation. It identifies the need to ask useful follow-up questions when initial patient information is sparse. It also highlights limitations of some existing methods, including treating unasked-about findings as absent and describing numerical trends without specifying the underlying estimators, making slope and change-point claims difficult to verify.
-
The experiments are relatively thorough, and the appendix provides details about the experimental setup and parameter settings.
Critical weaknesses
- The presentation of the method could be clearer. Although the authors provide many details about the proposed method, I still find it difficult to follow the descriptions of some modules and understand how they fit into the overall pipeline. For example, Section 3.2 introduces several technical terms, such as “rule-parsed intent,” “named estimator family,” “executable routine,” “planner,” “trend queries,” and “abrupt-change queries.” Concrete examples illustrating these concepts and their relationships would help readers better understand how the method works.
- Section 3.2 describes a finite schema covering slope, change-point score, and cohort z-score. However, the rationale for selecting these statistics and their adequacy for extracting relevant temporal evidence could be better explained. It would be helpful to discuss whether additional statistics, such as within-patient variability, could provide useful evidence beyond the current representation. I suggest organizing the explanation of each statistical output in a separate paragraph and clarifying what changes to the TSA schema and downstream knowledge base would be required to support additional statistics.
Questions for authors
Please address the questions and clarification requests raised in the Weaknesses section above.