- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Fuzzy Cognitive Topology Graph (FCTG), a knowledge-graph (KG) augmented LLM for diagnoses that proposes to represent symptoms and symptom-disease relationships as fuzzy numbers that can be composed under fuzzy arithmetic. The graph topology naturally captures uncertainty and normalized positive likelihood ratios and combines these quantities through approximate fuzzy multiplication and addition. Disesases are subsequently ranked by the resulting centroids, and a restricted candidate set is supplied to a frozen diagnostic LLM to complete the full KG-LLM setup.
Critical strengths
On the DDXPlus cases the model has SOTA results
The use of the fuzzy math + KG is highly creative, has valuable compositional features, and I find the construction to be very well motivated to the problem space itself of relating symptoms to diagnoses
Critical weaknesses
The benchmarks themselves are artificial (literally synthetic) and bear only a passing relationship to real medical use cases and distributions.
The baselines are sampled from similarly architected systems: MedRAG, MedGraphRAG, etc... while leaving out baseline LLM comparisons (how does Sonnet 5.5 or GLM5.3 perform on this?)
Questions for authors
How is scalar patient confidence computed and what is the scoring rule for the “scalar edge or product” (trapezoidal width) configuration?
Why not have more standard baselines for the diagnostic reasoning field (MedR-Bench, SD Bench, HealthBench Pro, etc...) ?