- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces an AutoResearch framework for patient-specific physiological prediction. The pipeline contains an LLM search agent for exploring model adaptation strategies, a deterministic validation gate, and a failure-diagnosis LLM agent that provides feedbacks. The framework is evaluated on two applications, including blood pressure estimation from ECG/PPG signals, and bioimpedance-based fluid-shift estimation. Experiments show improvements over population-level models and standard adaptation baselines.
Critical strengths
None
Critical weaknesses
-
Insufficient evidence to establish the necessity and effectiveness of the agentic components. The experiments do not demonstrate that the proposed multi-agent framework is necessary. For example: a) The failure-diagnosis agent provides limited benefits. In Table 1, the complete framework provides only marginal improvements over AutoResearch (SBP MAE: 5.77 → 5.72; DBP MAE: 3.32 → 3.28). In Figure 2C, AutoResearch already improves all 144 patients. b)The search scope of the AutoResearch agent is limited. The agent appears to operate primarily within a predefined search space for hyperparamters. It is unclear what advantages the LLM AutoResearch approach offers over conventional hyperparameter optimization or model selection methods. c) The framework is evaluated on only two small-scale datasets and it is unclear about its generalizability. In particular, the bioimpedance experiment uses real-world data from only two participants, which is insufficient to support claims about reliable patient-specific adaptation.
-
Poor presentation with limited scientific insights. The paper reads more like a case study report than a research paper and provides little scientific insight.
Questions for authors
None