- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Physiologically Aware Flow Matching (PAFM) addresses treatment forecast under OOD states that arise under altered treatments. To improve predictions under altered treatments, PAFM encodes domain knowledge of relations between physiological variables into a regularizing loss term over the derivative of the flow in the model. The paper measures the physiological consistency via the proxy metric of directional consistency. The paper demonstrates an improved tradeoff of directional consistency vs RMSE accuracy over 2 simulated benchmarks, compared to several baselines.
Critical strengths
The problem is well motivated. The idea of encoding domain knowledge via regularization of the flow direction is novel and interesting, and potentially useful.
Critical weaknesses
My main concern is the strength of the evidence. There are no theoretical results (which is understandable). If I understand correctly, the experiments present two simulated benchmarks that the authors devised, where the improvement is measured through a consistency metric that the authors defined. If I understand correctly, RMSE is measured only for the original treatment, As the motivation is about predicting well even when the treatment is modified - I would ideally expect to see a benchmark with "default" and "modified" treatments, where RMSE is improved explicitly for the modified treatments. Ideally on a public benchmark (to assure that the robustness to modified treatment isn't an overfitting of the method and simulated benchmark built with the same artifacts in mind).
Presentation: I'd use some visualization to make the paper more accessible - e.g. for the method and the results. nit: I'd also consider mentioning that the problem is essentially OOD prediction under control settings - this will be more familiar to some readers and more general that medical treatments alone.
Literature: The following two references proposed different approaches to address the same issue of prediction under modified treatment. I would either compare to them as baselines, or if for some reason they are not compatible with the benchmark - explain why. Forecasting Treatment Responses Over Time Using Recurrent Marginal Structural Networks (Lim et al, neurips 2018), Individualized Dosing Dynamics via Neural Eigen Decomposition (Belogolovsky, neurips 2023).
Questions for authors
Is my understanding of the experimental setup as described above correct?