- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces CortexFlow, an fMRI-to-image reconstruction framework designed to address two main issues in existing methods: the flattening of cortical spatial structure into 1D vectors, and the use of fixed diffusion hyper-parameters across all brain responses. Experimental results show that CortexFlow achieves competitive reconstruction performance on NSD across a broad range of low and high level metrics, with particularly strong structure-sensitive performance in SSIM.
Critical strengths
-
Across the four evaluated subjects, the method shows clear improvements on structural metrics like SSIM (reaching 0.502) and competitive numbers on high-level identification metrics compared to published baselines.
-
Rather than using a fixed noise level and fixed guidance for every test sample, using estimated feature agreement to pick the starting step and CFG scale is well-motivated and makes intuitive sense.
Critical weaknesses
-
The continuous spectral flow matching on the graph Laplacian is presented as a central contribution of the paper. However, the ablation in Table 2 only tests "Baseline" vs. "Baseline + topology". There is no comparison against straightforward graph neural networks (GCN/GAT) on the mesh, simple diffusion smoothing, or even a basic MLP over surface coordinates. As a result, it is impossible to tell if the complex ODE integration is necessary or if a simpler graph operator would achieve the same performance.
-
The overall system is very fragmented. The structural and semantic branches are trained separately as disjoint jobs. The confidence gates are trained on a separate held-out split with a separate loss. At test time, one branch runs 1,800 steps of DIP optimization, while the other runs an ODE flow and a 38-step diffusion process. This multi-stage design requires significant tuning, makes error propagation hard to track, and feels like an accumulation of loose heuristics rather than a unified framework.
-
My main concern about soundness is whether the heavy mathematical machinery of continuous spectral flow is actually doing what the authors claim. The model maps voxels to a template surface, truncates down to 128 low-frequency modes, integrates an ODE with 16 steps, pools back to 128 discrete functional clusters, and adds a residual MLP update. The paper does not provide an ablation comparing this continuous flow against much simpler alternatives, such as basic graph convolutions or standard spatial smoothing on the surface. Without that baseline, it is unclear if the gains come from the continuous spectral ODE or just from having an extra set of trainable residual parameters.
Questions for authors
-
Why choosing a continuous heat-process flow matching ODE over standard graph convolutions (such as ChebNet or GCN) on the surface mesh? Did you test any simpler graph baselines, and how do their reconstruction metrics compare?
-
How long does inference take for a single image? Running 16 RK4 steps for the ODE plus 1,800 optimization iterations for DIP and multiple diffusion steps seems very slow compared to direct feed-forward decoders.
-
Adding the confidence gates only gives a small improvement over the topology baseline (PixCorr goes from 0.387 to 0.392, SSIM from 0.491 to 0.502). Given that training these gates requires a dedicated dataset split and extra network heads, is this modest gain worth the added complexity?