- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces NeuroBelief, an observer-centric framework for predicting how acquiring an additional MRI sequence would change a task-specific spatial representation. A Belief Encoder constructs a deterministic “Pathology Belief” from available sequences, and an action-conditioned transition model predicts the representation after acquisition without accessing the candidate image. A Value Head estimates segmentation performance to guide sequence selection and stopping. Experiments on BraTS 2023 and BraTS Africa evaluate transition prediction, generalization to withheld transition combinations, and sequential acquisition.
Critical strengths
- Novel and clearly-articulated problem setting. Moving from "world models predict how a system changes" to "predicting how an observer's task state updates as evidence arrives," with a testable predict-then-verify loop (Fig. 1), is more principled than treating missing-modality MRI as a simple re-sampling problem.
- Careful control design. The paper includes meaningful predictive baselines (Identity, Spatial Population, Direct Logit Delta, Global, Seen Spatial Population), and reports paired 95% CIs and matched-budget sensitivity analyses (Table 7), indicating an honest approach to fair comparison.
Critical weaknesses
- Unclear necessity of spatial state prediction. Acquisition ultimately depends on predicted Dice, yet a matched direct Dice/gain regression baseline is missing. Direct Logit Delta nearly matches spatial accuracy, leaving the benefit of predicting a full latent state insufficiently isolated.
- Deterministic predictions without outcome uncertainty. Pathology Belief is explicitly a deterministic representation rather than a probabilistic posterior. The model therefore does not characterize alternative possible acquisition outcomes or provide uncertainty-based stopping guarantees.
- One-step greedy acquisition. The policy evaluates immediate predicted gains rather than performing multistep planning. It may overlook complementary sequences whose value emerges primarily when acquired together.
- Limited acquisition advantage. Population Fixed achieves slightly higher internal Dice with fewer sequences. At the primary threshold, budget-matched differences are negative internally and small externally. Paired confidence intervals are needed to establish the reliability of the policy-level differences.
- Incomplete evaluation of inference-time decisions. Table 1’s task-consequence metrics use ground-truth Dice of decoded predictions rather than Value Head estimates. Although valid retrospectively, these results do not establish accurate inference-time candidate ranking, gain estimation, or stopping calibration.
Questions for authors
- Please provide the missing architectural and preprocessing details, λ_mse, λ_mean, ε_rank, temperature T, baseline training protocols, and code location, and reconcile the inconsistencies in Figure 5 and the abstract.
- Are results available for directly predicting candidate Dice or gains using the same Belief Encoder and comparable supervision? If not, what existing evidence distinguishes the benefit of state prediction from that of the encoder and value-learning objectives?
- How would this policy actually be deployed in a real clinical scan? Given that the data already contain all four sequences, does "reducing 48.4%" imply a genuine decrease in scan time / cost? Can you provide a proxy model for acquisition time or cost?
- Why start from T1c rather than the more common clinical starting set T1c+T2? How do reduction and Dice vary across different starting points?
5 comments
Reply to Q3: The 48.4% figure represents the average reduction in the number of acquired sequences compared to the full four-sequence protocol within the BraTS 2023 internal test cohort. During retrospective evaluation, the model is restricted to using only the MRI data from the sequences already selected at each step. In a clinical workflow, after T1c and each subsequent acquisition, the model would update the patient state and recommend another sequence or stopping, subject to clinical protocol requirements.
We use the acquisition duration of each sequence as a proxy for cost. According to the routine 3T MRI protocol for gliomas reported by De Luca et al. [1], the acquisition times are 3 minutes and 50 seconds for both T1n and T1c, 2 minutes and 40 seconds for T2w, and 4 minutes and 08 seconds for FLAIR. We calculated the total duration for the selected sequences on a case-by-case basis and then determined the mean for the entire cohort. Both approaches include T1c, and its imaging time is factored into the estimates; however, the time required for contrast agent injection and the subsequent waiting period for enhancement is excluded.
| Test Cohort | Duration for Full Four-Sequence Protocol | Mean Estimated Duration (NeuroBelief) | Reduction in Estimated Duration |
|---|---|---|---|
| BraTS 2023 (125 cases) | 14 min 28 sec | 8 min 07 sec | 43.9% |
| BraTS Africa (95 cases) | 14 min 28 sec | 8 min 30 sec | 41.3% |
[1] De Luca F, et al. Diagnostic Performance of Fast Brain MRI Compared with Routine Clinical MRI in Patients with Glioma Grades 3 and 4: A Pilot Study. AJNR, 2025.
Reply to Q4: We start with a single sequence so that the strategy can decide whether to add T2w based on each patient’s available images. On the development set of 125 patients, the mean DSC across WT, TC, and ET was 0.814 for T1c, 0.712 for T2w, 0.703 for FLAIR, and 0.648 for T1n. We therefore selected T1c as the starting sequence.
Using the same frozen model, we compared four individual starting sequences and the T1c + T2w starting combination. For each configuration, the stopping threshold was selected using the same development set criterion. Acquisition reductions are relative to all four sequences, with the starting sequences included in the total. Table 1. Acquisition reduction and final DSC for different starting configurations
| Starting Configuration | BraTS 2023 Acquisition Reduction (%) ↑ | BraTS 2023 Final DSC ↑ | BraTS Africa Acquisition Reduction (%) ↑ | BraTS Africa Final DSC ↑ |
|---|---|---|---|---|
| T1c | 48.40 ± 6.92 | 0.847 ± 0.129 | 44.74 ± 10.25 | 0.819 ± 0.128 |
| T1c + T2w | 49.40 ± 3.84 | 0.842 ± 0.123 | 49.74 ± 2.56 | 0.815 ± 0.128 |
| T1n | 25.40 ± 3.15 | 0.847 ± 0.132 | 28.68 ± 9.63 | 0.816 ± 0.138 |
| T2w | 49.60 ± 4.47 | 0.841 ± 0.126 | 49.74 ± 2.56 | 0.815 ± 0.128 |
| FLAIR | 49.40 ± 3.84 | 0.849 ± 0.120 | 47.37 ± 7.71 | 0.814 ± 0.131 |
Compared with starting from T1c + T2w, starting from T1c yields a smaller acquisition reduction and a slightly higher mean final DSC in both cohorts.
We would like to thank the reviewer once again for their careful review; we will incorporate the necessary revisions and additions.
Dear Reviewer,
I hope this message finds you well. As the discussion period is nearing its end with less than eight hours remaining, I wanted to ensure we have addressed all your concerns satisfactorily. If there are any additional points or feedback you'd like us to consider, please let us know. Your insights are invaluable to us, and we're eager to address any remaining issues to improve our work.
Thank you for your time and effort in reviewing our paper.
We thank the reviewer for their careful review. Our point-by-point responses are provided below:
Reply to Q1: Model Architecture. The Belief Encoder uses a 3D CNN with three levels and 32, 64, and 128 channels, respectively. Four MRI sequences are provided in a fixed order, with missing channels set to zero. A sequence availability mask is embedded and added to the spatial features to obtain the current state, Bt. Spatial Dynamics maps the candidate sequence identity to a vector of 128 dimensions, concatenates it with Bt at each spatial location, and predicts a residual ΔB, yielding B^t+1=Bt+ΔB.
Segmentation Training and Evaluation. We train the segmentation model using MRI patches of 128×128×128 voxels. At testing, a sliding window of the same size covers each patient’s entire MRI volume. Window predictions are combined into a complete segmentation map, which is compared with manual annotations to calculate DSC for whole tumor (WT), tumor core (TC), and enhancing tumor (ET).
Hyperparameters, Baselines, and Code. We use λmse=0.1, λmean=0.5, εrank=0.01, and temperature T=0.05. RFNet, mmFormer, M3AE, and UniME in Table 3A follow their respective official training protocols and retain their training settings. All methods use the same patient splits and available sequence combinations. M3AE and UniME retain both pretraining and segmentation fine tuning stages.
The model is described in the supplementary material. We will provide a public repository containing the model implementation, training scripts, and evaluation code.
Figure 5 and the Abstract. Figures 5a and 5b show stopping counts, totaling 258/500 acquisitions on BraTS 2023 and 210/380 on BraTS Africa, corresponding to the abstract’s reductions of 48.4% and 44.7%. Their colors indicate whether final DSC is within 0.01 below each patient’s reference using all four sequences. Figure 5c shows the cumulative proportion of patients who have stopped and met this criterion. The abstract reports the mean DSC decreases across all patients, 0.68 and 1.41 percentage points, respectively. The 0.01 tolerance is used for retrospective evaluation, while τ=0.03 determines stopping.
Reply to Q2: We compared Direct Q with NeuroBelief using the same frozen Belief Encoder, regional DSC supervision, and value loss. Given the current patient state and a candidate sequence, Direct Q predicts the WT, TC, and ET DSC values after acquiring that sequence. NeuroBelief first predicts the resulting spatial state and then estimates the regional DSC values.
Best candidate hit rate measures how often the model selects the sequence with the greatest actual DSC gain from the same observed state. The remaining metrics come from complete closed loop evaluations starting from T1c, with acquisition reductions calculated relative to all four sequences. Stopping thresholds were selected using the same development set criteria, yielding 0.03 for NeuroBelief and 0.05 for Direct Q. After stopping, we checked whether any remaining sequence could increase the actual mean DSC by more than 0.03.
Both methods achieved similar candidate hit rates. Direct Q used fewer sequences, while NeuroBelief achieved a slightly higher mean final DSC and stopped less frequently when a remaining sequence could provide a gain above 0.03.
After acquisition, the spatial prediction can be compared at each location and channel with the state produced by the same frozen encoder from the updated observations. In Table 2, for sequence transitions unseen during dynamics training, NeuroBelief achieved Latent L1 errors of 0.111 on BraTS 2023 and 0.118 on BraTS Africa. Direct Q outputs only regional DSC values, so this spatial metric does not apply to it.