- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces CANDI, a generalizable INR framework that combines a bidirectional Mamba encoder with a coordinate-conditioned decoder adapted explicitly from LAGINR. The encoder takes patchified observation tokens interleaved with learnable tokens and outputs instant-specific latent representations. Two modality-specific contributions are introduced. For 4D fMRI, Sequential Locality Bias (SLB, Eq. 4) adds a quadratic penalty on the sequence distance between a query's patch and each latent in the decoder cross-attention, promoting latents close to the query's data token in the serialized sequence. For EEG, spherical harmonic positional encodings (SHPE, Eq. 5) and a field bending-energy penalty (Eq. 7) regularize the surface smoothness of the learned model. The authors quantitatively evaluate generalization to electrode locations withheld during training for EEG, reconstruction quality for fMRI, and downstream utility for both modalities. Note that my expertise is in INRs and computational imaging, but not specifically in fMRI or EEG.
Critical strengths
-
The EEG evaluation protocol meaningfully tests spatial generalization by holding out a fixed 40–87.5% of sensor positions from all supervision, directly testing whether the decoder represents a continuous field rather than a fixed sampling pattern.
-
The gains under EEG sparsity are promising. In Table 1, CANDI improves over ZUNA and SSI on all 3 metrics on both datasets across 3 different scales. It also degrades more gracefully than SSI and ZUNA as test-time context shrinks.
-
The paper offers a principled geometric motivation for EEG inductive biases. The connection between spherical harmonics, the Laplace-Beltrami operator, and spline smoothness is clearly explained and developed, motivating SHPE and the bending loss.
-
CANDI improves reconstruction quality and scales better in memory than the full-attention baselines. At matched patch sizes, CANDI outperforms other baselines across different volume sizes. The proposed method can also use finer patches in settings where LAGINR, TransINR, and Linformer, as implemented, run out of memory.
Critical weaknesses
Major weaknesses:
-
The current ablations do not fully isolate the benefits of the proposed changes over existing GINR components.
- In Table 5, replacing SHPE while keeping the bending loss results in training collapse, but removing both still produces a trainable model. This suggests an interaction between the encoding, the bending loss, and optimization. Because replacement encoding and its tuning are not specified, the failure is difficult to interpret as positive evidence for the advantage of SHPE. Another potentially useful ablation would be to replace Mamba with a Transformer encoder while keeping all the other remaining components.
- Table 6 only compares SLB against no bias. It does not show whether the gain depends on Mamba's serialization or whether a spatial-distance bias, or the same sequence-distance bias with a different encoder, would help equally.
-
The fMRI task is apparently autoencoding rather than full reconstruction, and the arbitrary-resolution claim is untested. The intended application utility of the fMRI experiments is not entirely clear.
- In computational imaging, “fMRI reconstruction” usually means recovering images from raw (for example, k-space) measurements through a forward model. Here, the inputs are already-reconstructed HCP volumes in MNI 2mm space, and the model encodes a volume and decodes that same volume with no forward model involved. Calling this “4D fMRI spatiotemporal reconstruction” (Line 24–25) or “4D volume reconstruction” (Line 428; Table 4) is therefore misleading; “autoencoding” or “representation fitting” would be more accurate.
- Separately, Figure 1(e) describes “fMRI full-volume reconstruction at arbitrary sizes” (), which suggests encoding at one resolution and decoding at another. However, Appendix A.2.2 resizes each frame by trilinear interpolation to the resolution required by each experiment, so each column of Table 4 appears to be a separately trained model whose input and output share one resolution. If so, decoding at a resolution other than the input’s is never evaluated.
Minor weaknesses:
-
Statistical reporting of quantitative results is either unclear or missing. Table 1 neither defines whether denotes standard deviation nor whether variability is computed over subjects, windows, layouts, or runs. The remaining results (Tables 2-6: fMRI reconstruction, both downstream experiments, and both ablations) do not report any variability metrics.
-
Implementation details for EEG baselines are missing. The paper describes CANDI's training in detail but does not comparably specify the ZUNA checkpoint/version, its inference settings, whether it is pretrained, retrained, or fine-tuned. Similarly, the SSI spline order, number of Legendre terms, and numerical interpolation are not reported. These choices matter for interpreting Table 1, particularly because SSI outperforms ZUNA in several settings, and would help assess whether configuration differences affect the comparison results.
-
Section 3.2 attributes the cross-attention decoder to LAGINR, so the coordinate-to-latent cross-attention itself is not new and the contribution here is the SLB term added to its attention softmax (Eq. 4). However, Figure 2 places the contribution star on the entire “Sequential Locality-Biased Cross-Attention” block. Please mark only SLB as the contribution in Figure 2 and its caption.
-
In Eq. 4, in the expression for seems to refer to the query's data token index, which overloads as the query coordinate. Please define and explicitly and report how is selected.
-
Figure 2 and Section 3.2 present spatiotemporally decoupled positional encodings as one of the paper's contributions. However, separately encoding spatial and temporal coordinates with different frequency ranges has precedent in dynamic neural fields. For example, D-NeRF (Pumarola et al., 2021) [1] uses (L=10) for spatial coordinates and (L=4) for time. Please cite relevant prior works and clarify what is novel about CANDI’s use of this design.
-
A relevant and recent EEG baseline that supports querying unseen coordinates is missing. Lines 142-144 acknowledge that Liu et al. (2026a) and ZUNA can both query new positions, but the experiments compare only against SSI and ZUNA. The argument for excluding fixed-montage methods in Lines 357-360 does not explain this omission.
-
Some numerical results need clarification:
- In Table 4 at volume size , Linformer and TransINR (both with patch size ) report exactly identical values of and . I'd like to confirm if this is a typo or the actual result for both.
- The full model in Table 5 (first row with NMSE 0.3683, SNR 4.34, and PCC 0.8190) matches no row of Table 1 and the ablation's scale and experimental setup are also not specified.
-
Under identical normalization, essentially equals , so having both metrics is a bit redundant (though perhaps convenient for readers).
-
Writing issues:
- Please make sure you are using
\citep()appropriately for parenthetical citations. For example, it should be "(Gu et al., 2022)" on Line 160, "(Perrin et al., 1989)" on Line 168, "(Wahba, 1981)" on Line 171, etc. In general, if you would not say the citation out loud when reading the sentence, \citep is appropriate. - Typos include "low-passnfiltering" in Lines 301-302, "metrics(Table 5)" in Lines 464-465, and "oto facilitate" in Line 813.
- Lines 466-467 read as if removing both SHPE and the bending loss collapses training, but Table 5 shows that configuration trains while removing SHPE alone does not. Please clarify.
- Please make sure you are using
[1] Pumarola, Albert, et al. D-NeRF: Neural Radiance Fields for Dynamic Scenes. CVPR 2021.
Questions for authors
-
Algorithm 1 computes a single loss over all seen electrodes while Section 3.4 and Eq. 8 weight the target and reconstruction terms separately with . Can the authors clarify this inconsistency and update Algorithm 1 to match Eq. 8?
-
Can the authors provide implementation details for the EEG baselines (SSI and ZUNA) and fMRI baselines (LAGINR, Linformer, TransINR, and SCENT)? Can the authors also clarify the experimental settings of the two ablations (Tables 5 and 6)?
-
Can the authors report uncertainty estimates for all experiments (main experiments, downstream experiments, and ablations) and clearly identify the source of variability (e.g. seeds, layouts, test subjects, runs)?
-
For Table 5, can the authors also ablate the Mamba encoder (e.g., replace it with a different Transformer encoder)? For Table 6, can the authors compare SLB with a spatial distance bias and with the same bias applied to a different encoder?
-
For the Table 4 setting, can the authors report encoder and decoder costs separately, full-volume inference latency, and the attention implementation used for the Transformer baselines (e.g., whether a memory-efficient kernel like FlashAttention was used)?
-
Mamba is order-sensitive, but EEG positions form an unordered set and the fMRI scan order is unspecified. How are tokens ordered in each case, how sensitive are the results to that order, and does it affect the interpretation of SLB?
-
Can the authors clarify the fMRI resolution setup in Table 4: at which volume and patch size was each model trained, and is it evaluated at that same size (representation) or at a different one (upsampling or downsampling)? If cross-resolution decoding is supported, can the authors evaluate it (for example, encode and decode ) against interpolation baselines such as trilinear, cubic, or sinc upsampling?
7 comments
Extended Ablations (SLB)
b) Strengthening the SLB ablations (Table 6)
For Table 6, can the authors compare SLB with a spatial distance bias and with the same bias applied to a different encoder? ... Table 6 only compares SLB against no bias. It does not show whether the gain depends on Mamba's serialization or whether a spatial-distance bias, or the same sequence-distance bias with a different encoder, would help equally.
We thank the reviewer for these suggestions that improve the isolation of SLB and its dependence pn architectural properties. To investigate whether SLB's improvement depends on the locality formulation, encoder architecture, or token serialization, we conduct additional ablations using the same setting as Table 6 at 256 learnable tokens. For details, see Appendix E.1.1 (Table 28) and E.1.2 (Table 29).
Spatial bias and encoder comparison. We compare Mamba + SLB against Mamba with a spatial-distance bias and Transformer + SLB to investigate the roles of the locality formulation and encoder architecture. Under the tested configurations, Mamba + SLB yields lower MSE than Mamba + spatial bias (1.6384 vs. 1.9927, both ), while SLB does not improve the Transformer (2.7248 vs. 2.5194, both ). We restrict this conclusion to the evaluated bias formulation; see Appendix E.1.1, Table 28. Values in (a) are mean ± reported SEM.
(a) Bias and encoder ablations
| Encoder | Bias | MSE ↓ (×10⁻⁴) |
|---|---|---|
| Mamba | None | 1.8561 ± 0.0401 |
| Mamba | SLB | 1.6384 ± 0.0358 |
| Mamba | Spatial | 1.9927 ± 0.0554 |
| Transformer | None | 2.5194 ± 0.0816 |
| Transformer | SLB | 2.7248 ± 0.0812 |
Mamba is order-sensitive, but EEG positions form an unordered set and the fMRI scan order is unspecified. How are tokens ordered in each case, how sensitive are the results to that order, and does it affect the interpretation of SLB?
As explained in Section 3.2, SLB is used only for fMRI. For EEG, each sequence token is a temporal patch containing the entire electrode set; Mamba scans temporal patches, not electrodes individually (Appendix B.1.1). For fMRI, the default patch order is HWDT, expanding the leftmost dimension fastest to the rightmost slowest (Appendix E.1.2).
Serialization-order comparison. We evaluate SLB and no bias under HWDT, WDHT, and DHWT orderings. SLB improves MSE by 9.55–10.99% across these three single-seed comparisons; this is not a permutation-invariance claim. See Appendix E.1.2, Table 29. (b) uses a single seed.
(b) Serialization-order ablations
| Ordering | SLB | No bias | % gain |
|---|---|---|---|
| HWDT | 1.70 × 10⁻⁴ | 1.91 × 10⁻⁴ | 10.99% |
| WDHT | 1.80 × 10⁻⁴ | 1.99 × 10⁻⁴ | 9.55% |
| DHWT | 1.73 × 10⁻⁴ | 1.93 × 10⁻⁴ | 10.36% |
These comparisons support an SLB benefit for the tested Mamba configurations, without establishing that all spatial-distance biases are inferior. Further setup and interpretation are in Appendix E.1.1–E.1.2, Tables 28–29.
Repeated-seed evaluation. We repeat the SLB versus no-bias comparison using three matched seeds at 64, 128, and 256 learnable tokens. We report the mean paired MSE improvement and its 95% confidence interval below; individual seeds and the complete statistical analysis are in Appendix C.6, Table 26.
Rebuttal Table 2: SLB ablation across three matched training seeds. MSE (×10⁻⁴) is reported as mean ± SD. Improvements denote paired-seed relative MSE reductions (mean ± SD), with 95% confidence intervals. See Appendix C.6, Table 26 for individual seed results and detailed statistical analysis.
| Tokens | No SLB MSE | SLB MSE | % Improvement | 95% CI |
|---|---|---|---|---|
| 64 | 2.018 ± 0.068 | 1.935 ± 0.110 | 4.12% ± 4.42% | [−6.87%, 15.10%] |
| 128 | 1.951 ± 0.021 | 1.775 ± 0.052 | 9.02% ± 3.24% | [0.98%, 17.06%] |
| 256 | 1.906 ± 0.052 | 1.702 ± 0.061 | 10.65% ± 2.80% | [3.69%, 17.61%] |
SLB improves MSE for all nine matched-seed comparisons, with 95% confidence intervals for mean improvement excluding zero at 128 and 256 tokens, but not at 64 tokens (Appendix C.6, Table 26).
Clarifying Scope
2. Clarifying the fMRI reconstruction task and experimental scope
The fMRI task is apparently autoencoding rather than full reconstruction, and the arbitrary-resolution claim is untested. The intended application utility of the fMRI experiments is not entirely clear.
Definition of reconstruction. We thank the reviewer for highlighting this ambiguity. We use "reconstruction" in the image-domain sense established in the INR literature [1, 2], where a learned implicit representation reproduces an observed signal. This differs from the computational-imaging definition involving recovery from raw measurements through an acquisition forward model. We agree that our fMRI task is a form of autoencoding: CANDI operates on preprocessed HCP volumes, not raw k-space measurements, and does not address the MRI acquisition inverse problem. We have added an explicit definition of our use of "reconstruction" in Section 1 [068–070]:
"Throughout this paper we use 'reconstruction' in the image-domain sense common in INR and GINR literature (Lee et al., 2023; Sitzmann et al., 2020; Chen and Wang, 2022), referring to reproducing an observed signal through a learned implicit representation, rather than recovering images from raw acquisition measurements."
Experimental objectives and scope. Our fMRI experiments evaluate whether CANDI can learn compact representations that faithfully preserve high-dimensional spatiotemporal signals. Same-resolution reconstruction error measures signal preservation through the encoder-decoder architecture and allows us to assess scalability across volume resolutions and latent-token budgets. We complement this with downstream sex classification and age regression to evaluate whether the learned representations retain information useful beyond voxel-level reconstruction. We prioritize these tasks over interpolation because established methods provide strong baselines on regularly sampled fMRI grids [3], while the slow BOLD response limits the physiological information recoverable through naive temporal interpolation [4, 5]. More nuanced forms of temporal interpolation like slice-timing correction are outside of the scope of this paper. Thus, reconstruction serves as a representation-learning benchmark rather than an MRI acquisition inverse problem; we do not claim arbitrary-resolution upsampling/downsampling or temporal extrapolation for fMRI.
Can the authors clarify the fMRI resolution setup in Table 4: at which volume and patch size was each model trained, and is it evaluated at that same size (representation) or at a different one (upsampling or downsampling)? ... Separately, Figure 1(e) describes "fMRI full-volume reconstruction at arbitrary sizes", which suggests encoding at one resolution and decoding at another.
Manuscript clarifications. We make several changes to the manuscript to make the claims from the experimental objectives and scope above more explicit and avoid confusion. We acknowledge that the original Figure 1(e) could suggest cross-resolution reconstruction for fMRI. We have corrected this figure by explicitly noting that the input and output dimensions of reconstruction are the same, by resizing the physical squares representing input and output to be the same, and removing the "arbitrary size" language. We have also revised Section 4.3 [411-413] to specify that Table 4 evaluates separately trained models at the same input and output resolution, not upsampling or downsampling; no cross-resolution comparison is claimed.
[1] Lee et al. (2023). "Locality-Aware Generalizable Implicit Neural Representation." NeurIPS 2023.
[2] Chen and Wang (2022). "Transformers as Meta-Learners for Implicit Neural Representations." ECCV 2022.
[3] Lehmann, T. M., Gönner, C., and Spitzer, K. (1999). "Survey: Interpolation methods in medical image processing." IEEE Transactions on Medical Imaging, 18(11), 1049–1075.
[4] Boynton, G. M., Engel, S. A., Glover, G. H., and Heeger, D. J. (1996). "Linear systems analysis of functional magnetic resonance imaging in human V1." Journal of Neuroscience, 16(13), 4207–4221.
[5] Logothetis, N. K. (2008). "What we can do and what we cannot do with fMRI." Nature, 453(7197), 869–878.
Extended Ablations (EEG)
1. Extended ablations to isolate CANDI mechanisms
a) Strengthening the EEG ablations (Table 5)
Clarifying the positional encoding ablation. The alternative encoding in Table 5 is the standard Fourier positional encoding as formulated in Eq. 3, which is also used for all fMRI experiments. When retaining the bending-energy regularizer without SHPE, this configuration exhibits training instability characterized by a sharp increase in the smoothing loss early in training, which the model does not recover from. We tested multiple Fourier bandwidths (from [128, 32, 8] to [2, 1, 0.5]), peak learning rates (from 5×10−4 to 1×10−5), and smoothing loss weights (from 0.01s to 0.0001), but did not obtain stable training. We have not conducted rigorous interpretability tests on exactly why this interaction occurs, but one possible explanation is that SHPE is naturally aligned with the spherical geometry underlying the bending energy regularizer, whereas standard Fourier features do not explicitly encode this geometry. We agree that this result reflects an interaction between encoding and regularization, rather than independently establishing SHPE's superiority, and have clarified this interpretation in the manuscript.
Additional Transformer ablation. Following the reviewer's suggestion, we replace Mamba with a Transformer encoder while retaining SHPE, bending regularization, the frequency curriculum, and the coordinate-query decoder. We use the same optimization settings and training budget without independently tuning the Transformer. The geometric components give similar NMSE and PCC with Mamba (0.3683, 0.8190) and Transformer (0.3684, 0.8136), supporting their usefulness across encoder types. For experimental details, see Section 4.4 and Table 5 of the revised manuscript.
Rebuttal Table 1: Ablation of EEG-specific components on SEED-V unseen-electrode reconstruction. DNT denotes that it does not train, with PCC approximately 0.00.
Removing SHPE together with the bending loss worsens both encoders, while Fourier PE with bending loss does not train stably in the tested settings. See Section 4.4 and Table 5 for the full ablation.