- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Hi-DREAM organizes fMRI regions into early, middle, and late visual streams and injects their representations at corresponding diffusion-model depths. It reports strong NSD reconstruction metrics and uses ROI, hierarchy, and attention ablations to argue for structured cortical conditioning.
Critical strengths
The paper tests a concrete, interpretable conditioning hypothesis, including capacity-matched random and reversed hierarchy controls in Table 3. Table 1 reports strong semantic performance across four NSD subjects, while retaining competitive low-level reconstruction quality.
Critical weaknesses
- The evaluation inputs are unresolved in a way that could change the task. Figure 2 does not specify the source of evaluation text, and the supplied evaluation procedure requests stimulus-associated captions for conditioning. The available materials do not establish whether captions were used in the runs behind Table 1, but reconciling those runs with an explicitly neural-input protocol is necessary before the comparison can substantiate fMRI-based reconstruction.
- The spatial representation is not adequately connected to the information it is claimed to preserve. Section 3.2 reduces each ROI to a scalar response multiplied by a projected anatomical mask, removing within-ROI activity patterns. The paper correctly states that the masks do not encode stimulus edges, but does not establish how anatomical coordinates correspond to image coordinates or how this compressed input preserves stimulus-specific layout; this is central to the spatial-conditioning motivation.
- The hierarchy controls do not distinguish a useful anatomical bias from disadvantages imposed by alternative priors. Section 3.3 encourages early-to-shallow and late-to-deep mixing, while Table 3 reverses the prior and initialization together. These controls support the selected configuration, but a neutral initialization without the anatomical regularizer would better establish whether the preferred correspondence emerges from the data and contributes beyond a generally learnable multiscale conditioner.
- The module ablation does not isolate the claimed cross-stream mechanism. Table 4 shows a large improvement from adding MHLA, but removing attention changes both model capacity and information exchange. Comparing against a similarly sized generic mixer using the same ROI inputs would test whether structured cross-stream interaction explains the gain, rather than the additional processing capacity; this matters because the proposed mechanism is a principal methodological contribution.
- The quantitative ROI ablation is insufficient to establish the stated complementary roles. Table 2 compares Early, Early+Middle, and Early+Middle+Late, so each step also supplies additional neural information. The qualitative examples are suggestive, but Middle-only, Late-only, or matched leave-one-stream-out measurements on the existing test set would better distinguish the proposed functional specialization from the general benefit of observing more regions.
Questions for authors
- Were stimulus-associated captions supplied in the runs behind Table 1 and the ablations? Please reconcile the evaluation materials with those runs and establish the results with text that is empty, stimulus-independent, or derived solely from fMRI.
- How are anatomical coordinates related to visual-field coordinates, and what spatial information remains after ROI averaging? Does the hierarchy advantage persist against neutral ROI-to-depth mixing and a capacity-matched generic mixer?
- Do quantitative leave-one-stream-out results support the proposed structural and semantic specializations, beyond the improvement from adding more neural information?