- Rating
- 3(+2)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposed a medical world model built in hyperbolic space to adapt pretrained LLMs to predict future lab values from historical records and treatment sequences.
Critical strengths
This work is well-motivated. It outperforms models such as MedGemma-27B with a best average score of 72.10.
Critical weaknesses
In this paper, the central justification for hyperbolic geometry remains unconvincing. Moreover, the empirical evidence is insufficient to establish robustness and generalizability.
Questions for authors
Comments
- The authors claim that existing EHR-based world and trajectory models are built upon Transformer representations. However, it does not show that all existing large language models rely on Euclidean representation spaces. It is overly broad.
- The motivation for replacing Euclidean representations entirely with hyperbolic geometry is insufficient. Please discuss their complementary strengths and compare the proposed approach with hybrid Euclidean–hyperbolic representations.
- Figure 1 appears to motivate hyperbolic geometry primarily through rare diseases. Please investigate whether its benefits extend to common diseases and identify the conditions under which each representation space is preferable.
- Please specify the exact MIMIC-IV version used, together with the cohort selection and preprocessing procedures, to ensure reproducibility.
- Please clarify the clinical settings and qualify the contributions accordingly.
- Clinical inputs contain heterogeneous modalities and data types. Please clarify how they are encoded and integrated, and whether a shared hyperbolic representation is appropriate for all of them.
- The construction of the SOFA-based severity levels is insufficiently explained. Please provide the thresholds, their rationale, and evidence supporting their clinical validity.
- Eq. (7) introduces at least four hyperparameters, raising concerns about dependence on extensive tuning. Please report the search spaces, selection criteria, and tuning budgets.
- The sensitivity analysis in Appendix Table 11 is restricted to Qwen3-8B and laboratory prediction. Please extend it to additional models, tasks, and datasets to establish the robustness.
- Table 2 provides limited coverage of strong contemporary baselines, particularly larger models. Please broaden the comparisons and justify the selection of baseline architectures and model sizes.
- Please analyze the computational complexity, report training time, inference latency, and token usage relative to the baselines.
4 comments
Author Response to Reviewer CPez: Part2
C4. Cohort Construction and Preprocessing
We clarify that our cohort is extracted from MIMIC-IV v3.1 (accessed via PhysioNet under credentialed access). Furthermore, the detailed cohort selection, round partitioning, and preprocessing procedures are already documented in Appendix A (Sections A.1–A.4) of the manuscript. Specifically: (1) source table extraction (labevents, emar, procedures_icd, microbiologyevents, patients, admissions, discharge) is detailed in Appendix A.1; (2) timeline integration, deduplication (~7.03M duplicate events removed), length-of-stay (< P90) and event-count (P10–P90) filtering, and treatment-round partitioning are described in Appendix A.2; and (3) SOFA-lab3 baseline filtering (retaining 50,680 candidate rounds) and subject-level disjoint splitting (10,001 train / 302 val / 996 test; 11,299 total) are provided in Appendix A.4. In the revised manuscript, we will explicitly specify MIMIC-IV v3.1 and add a cross-reference to Appendix A in Section 3.1, and we will release the complete preprocessing scripts upon acceptance.
C5. Clinical Setting and Scope Boundaries
We thank the reviewer for the suggestion, but we would like to respectfully clarify that the clinical settings and boundaries of our work are already explicitly defined throughout the manuscript. Specifically, Section 3.3 (Task Definition) formally defines the scope as treatment-driven patient-state and laboratory prediction under EHR observations, and Section 1 clearly bounds the setting to ICU patient trajectories. Furthermore, our Ethics Statement explicitly qualifies that TheraWorld's outputs are probabilistic approximations of ICU trajectories from a single institution, and they should not be interpreted as causal intervention estimates, ground-truth forecasts, or direct clinical treatment recommendations.
C6. Structured Serialization and Token-Level Integration
As detailed in Appendix A.3 and Appendix H (Tables 15–16), all heterogeneous clinical inputs (including laboratory values, microbiology results, medications, procedures, and timestamps) are serialized into a unified structured JSON-like text schema, encoded as token sequences via the LLM tokenizer, and integrated through standard Transformer attention. Crucially, there are no separate modality encoders or modality-specific hyperbolic projections: our HypLoRA adapters operate locally on individual token-level activation vectors within the attention and feed-forward projection layers, leaving the backbone's cross-modal token interactions intact. Furthermore, this heterogeneity is precisely why a shared hyperbolic space is advantageous—its negative curvature and exponential capacity naturally accommodate multi-granular, hierarchical, and heterogeneous clinical concepts within a single unified manifold without geometric distortion. We will add a brief summary of this serialization and integration mechanism in Section 4.1 for greater clarity.
Author Response to Reviewer CPez: Part3
C7. Clinical Validation of SOFA-lab3
We thank the reviewer for this comment. As detailed in Appendix A.4 and Table 6, our severity levels are directly constructed from the standard Sequential Organ Failure Assessment (SOFA) criteria using three objectively measured laboratory-based organ components, each scored from to (aggregate score ). The rationale for selecting these three laboratory-grounded components is to avoid subjective clinical charting noise (e.g., Glasgow Coma Scale) and missing bedside ventilator/vasopressor charting while maintaining high temporal precision across ICU treatment rounds. Clinically, SOFA is the gold-standard ICU severity metric endorsed by the Sepsis-3 consensus guidelines[1] and extensively validated as a robust predictor of ICU morbidity and mortality[2,3].
To further validate the clinical fidelity of our SOFA-lab3 construction and predictions, we provide two additional quantitative analyses across the test set:
- Clinical Fidelity of Predicted SOFA-lab3 (996 test samples): From predicted next-round laboratory values, we derive SOFA-lab3 and compare it against ground truth. Both models achieve , substantially outperforming the previous-round-as-prediction baseline (). Crucially, when the predicted SOFA-lab3 changes from the previous round, TheraWorld is accurate 67.3% of the time (vs. 17.3% for the previous-round baseline), confirming genuine clinical trajectory prediction rather than historical copying.
| Metric | Qwen3-8B | Qwen3-14B |
|---|---|---|
| SOFA exact match | 80.6% | 79.9% |
| SOFA within ±1 | 99.2% | 99.0% |
| Spearman ρ (predicted vs. actual SOFA) | 0.915 | 0.910 |
| Spearman ρ (previous round as baseline) | 0.843 | 0.839 |
- Monotonic Geometric Alignment Across Scales: Across all three model scales, the learned hyperbolic radius increases strictly monotonically with clinical severity:
| SOFA group | Qwen3-4B radius | Qwen3-8B radius | Qwen3-14B radius |
|---|---|---|---|
| 0 | 0.866 | 0.880 | 0.823 |
| 1 | 1.084 | 1.036 | 0.993 |
| 2 | 1.194 | 1.139 | 1.114 |
| ≥3 | 1.291 | 1.330 | 1.304 |
We will integrate these clinical validation references and supplementary quantitative results into Section 3.1 and Appendix G.1 of the revised manuscript.
C8. Hyperparameter Sensitivity and Search Budget
We would like to point out that a comprehensive sensitivity analysis across all four hyperparameters in Eq. (7) is already provided in Appendix G.3 and Table 11 (spanning , , , and , alongside LoRA rank ).
As demonstrated in both Table 11, model performance remains remarkably stable across the entire grid, varying any single radial weight (). This confirms that these regularization terms shape the latent geometry smoothly without requiring extensive hyperparameter tuning.
[1]Singer, M., Deutschman, C. S., Seymour, C. W., et al. (2016). The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA, 315(8), 801–810.
[2]Ferreira, F. L., Bota, D. P., Bross, A., Mélot, C., & Vincent, J. L. (2001). Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA, 286(14), 1754–1758.
[3]Raith, E. P., Udy, A. A., Bailey, M., et al. (2017). Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit. JAMA, 317(3), 290–300.
Author Response to Reviewer CPez: Part4
C9. Cross-Scale Generalization and Robustness
We thank the reviewer for this suggestion. While we appreciate the goal of establishing broader robustness, we respectfully argue that exhaustive hyperparameter grid searches across additional backbones, tasks, and datasets are unnecessary to support our core conclusions for two reasons:
Zero-Retuning Cross-Scale Generalization: Rather than tuning hyperparameters separately for each model scale, we applied the exact default configuration selected on Qwen3-8B directly to both Qwen3-4B and Qwen3-14B without any re-tuning. As shown in Table 2, Table 3, and Figure 6, TheraWorld consistently outperforms Euclidean baselines and achieves monotonic severity-radius alignment across all three scales (), directly confirming that the hyperparameters transfer seamlessly across model sizes.
Rich Clinical Diversity and Computational Practicality: Derived from MIMIC-IV, our dataset already spans 387 distinct lab labels, 1,212 medications, 53 organisms, and 11,299 multi-round trajectories across diverse ICU populations. Given that our sensitivity analyses (Table 11) already demonstrate minimal variance across parameter ranges, repeating full multi-parameter sweeps across additional backbones and external datasets would incur prohibitive GPU costs (34–62 GPU-hours per run) without altering our central finding that hyperbolic geometry drives the observed gains.
C10. Baseline Coverage and Selection Rationale
We thank the reviewer for this comment, though we would like to respectfully clarify that Table 2 already provides extensive coverage of 16 contemporary baselines across three distinct categories and a wide parameter spectrum (4B to 744B): (1) proprietary frontier models (GPT-5-Mini and Claude-Haiku-4.5); (2) 9 open-source general-purpose models spanning small-to-massive scales, including Qwen3 (4B, 8B, 14B, 235B-A22B), Qwen3.5-122B-A10B, MiniMax-M2.7 (229B), DeepSeek-V4-Flash (284B), Llama-4-Maverick (400B), and GLM-5.1 (744B); and (3) 5 specialized open-source medical LLMs (MedGemma-4B-IT, MedGemma-27B-IT, HuatuoGPT-01-8B, FineMedLM-01, and Baichuan-M2-32B). Notably, our largest evaluated baselines (GLM-5.1 at 744B and Llama-4-Maverick at 400B) are over 28× to 53× larger than our largest model (TheraWorld-14B), yet TheraWorld-14B still outperforms all of them (72.10 vs. 69.06 and 69.15 average score). Our selection rationale was specifically designed to: (i) ensure strict same-backbone fairness across 4B/8B/14B scales (against Base, LoRA, and SFT in Table 3), (ii) isolate domain pretraining effects via specialized medical LLMs, and (iii) test whether geometric inductive bias can surpass massive general-purpose scaling.
C11. Computational Complexity and Training Efficiency
We thank the reviewer for this suggestion. We note that our distributed training setup and baseline computational budgets were initially outlined in Appendix F.2. To provide a complete complexity and efficiency breakdown relative to baselines, we report the exact parameter counts, training wall-clock time, inference latency, and token usage below:
| Method | Trainable params | Total params | Training wall-clock |
|---|---|---|---|
| LoRA-8B-r16 | 83M | 8.2B | ~18h |
| SFT-8B | 8.2B | 8.2B | ~34h |
| TheraWorld-8B-r16 | 85M | 8.2B | ~20h |
Complexity & Training Overhead: HypLoRA introduces only lightweight rank- adapter updates plus exponential/logarithmic map operations of complexity per adapted layer, along with a 2M-parameter state projection head. The auxiliary self-supervised state consistency loss (, Section 4.3) requires a teacher forward pass, resulting in only a 7% per-step overhead (11% total training overhead over standard LoRA) while remaining substantially more efficient than full SFT.
Zero Inference Overhead: At inference time, the teacher branch and auxiliary regularization heads are completely discarded (Section 4.3), and HypLoRA adapters are merged directly into the frozen backbone weights. Consequently, TheraWorld incurs zero additional inference latency or memory overhead compared to standard LoRA or SFT, averaging ~13 seconds per sample with input ~2,837 tokens and output ~571 tokens on a single A100-80GB.
Summary
We once again thank the reviewer for their time, careful reading, and constructive engagement with our work. We kindly invite the reviewer to review the specific architectural designs, ablation results, and extensive baseline comparisons detailed throughout our manuscript and this response. Our work represents a rigorous, principled effort to introduce non-Euclidean geometric inductive bias into clinical EHR modeling, backed by solid theoretical motivation, extensive empirical evaluations across 16 state-of-the-art baselines, and thorough clinical validation. We hope this comprehensive evidence addresses all concerns and demonstrates the substantial contributions of TheraWorld.
Author Response to Reviewer CPez: Part1
We thank the reviewer for their careful reading and constructive feedback. However, we respectfully disagree with the assessment that our motivation for hyperbolic geometry is unconvincing and that our empirical evidence lacks robustness.
On the Motivation of Hyperbolic Geometry: Our work is grounded in the intrinsic tree-like and hierarchical nature of multi-scale disease progression and clinical state transitions in Electronic Health Records (EHR) (Section 1 & 3). As mathematically and empirically demonstrated, Euclidean spaces fail to faithfully embed exponential growth and hierarchical clinical trajectories without severe distortion, whereas hyperbolic representations naturally capture these properties (Section 3.2).
On Empirical Sufficiency and Robustness: Our evaluation is rigorous and comprehensive, encompassing 16 contemporary baselines (ranging from 4B to 744B parameters, including proprietary frontier models, general open-source LLMs, and specialized medical LLMs) across 11,299 multi-round trajectories (Table 2). Furthermore, extensive sensitivity analyses (Appendix G.3), cross-scale zero-retuning transfer (4B/8B/14B), and multi-task validation collectively establish the stability and generalizability of our approach.
Below, we provide detailed, point-by-point responses (Points 1–11) addressing all specific concerns, backed by our comprehensive ablation data and efficiency profiles.
C1. Scope of Euclidean Representations in EHR World Models
To clarify, our claim specifically targets existing EHR-based world and trajectory models (e.g., Mu et al., 2026; Adam et al., 2026) rather than all generic LLMs. Because these current EHR models are built upon standard Transformer architectures, their hidden representations and operations natively reside in flat Euclidean spaces (Rn) unless explicit non-Euclidean geometric constraints are introduced. Thus, their reliance on Euclidean representations holds within this domain. To prevent any over-generalization, we will tighten the wording in the Abstract and Section 1 to explicitly reflect this scope (e.g., "standard Transformer-based EHR models operate in Euclidean spaces").
C2. Hybrid Architecture and Euclidean Control
First, we clarify that TheraWorld does not entirely discard Euclidean representations, but inherently operates as a hybrid Euclidean–hyperbolic architecture: the frozen LLM backbone preserves its strong general linguistic and linear reasoning capabilities in Euclidean space, while HypLoRA injects hyperbolic geometric inductive bias into the adapter pathway via exponential and logarithmic maps to capture hierarchical medical concepts and exponentially expanding severe states. Second, to empirically verify the necessity of hyperbolic geometry over purely Euclidean spaces under identical structural supervision, we conducted a Euclidean control experiment (above table) by applying the exact same consistency and radial regularization losses to standard Euclidean LoRA. As shown below, forcing radial and consistency constraints in flat Euclidean space severely degrades performance across all metrics (e.g., S@10 drops from 57.40% to 43.98%), because polynomial volume growth (Rd) induces severe crowding of high-acuity patient states. We will explicitly highlight this hybrid synergy and include a discussion comparing pure, hybrid, and fully hyperbolic designs in the revised manuscript.
C3. Motivation: State Expansion and Long-Tail Distribution
We thank the reviewer for the question, but there is a misunderstanding of our core motivation: our geometric design is not tied to "rare versus common diseases," but rather to the intrinsic structural properties of EHR data at the vocabulary level (long-tailed frequency distribution) and the patient-state level (exponentially expanding organ-dysfunction states). As empirically demonstrated in our pilot experiments (Section 3.2), hyperbolic space is preferable when dealing with specialized low-frequency medical concepts and complex, high-acuity patient trajectories that require large representational capacity to prevent state crowding. Conversely, Euclidean space remains suitable for routine, low-complexity clinical records with sparse concept combinations.