acceptodds
Under review as a conference paper at ICLR 2027

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

Abstract

Functional near-infrared spectroscopy (fNIRS) provides portable, low-cost, and spatially localized measurements of cortical hemodynamics, but substantial differences in channel count, probe layout, signal distribution, and task type hinder joint pretraining across datasets. We introduce GeoNIRS, a geometry-aware pretraining framework that uses the physical locations of source–detector pairs as a shared spatial reference across heterogeneous probe layouts. GeoNIRS compresses variable-size channel sets into a fixed-size latent representation and employs bidirectional HbO/HbR cross-reconstruction with contiguous temporal masking to learn transferable representations. GeoNIRS-base is pretrained on eight heterogeneous datasets, while GeoNIRS-large scales pretraining to 22 datasets. Neither the data nor labels of the downstream tasks are used during pretraining, enabling evaluation under a strict cross-task setting. To the best of our knowledge, GeoNIRS is the first fNIRS framework to explicitly model physical channel geometry during joint pretraining across heterogeneous channel configurations, and the first to provide both complete source code and downloadable pretrained checkpoints. We evaluate GeoNIRS on eight held-out tasks spanning clinical and auditory assessment, pain and affective processing, semantic decoding, and motor function. GeoNIRS achieves the highest task-averaged balanced accuracy among the evaluated conventional machine-learning, fNIRS-specific, general time-series, and fNIRS pretraining baselines. Compared with random initialization, pretraining improves task-averaged balanced accuracy by 4.12 percentage points under linear probing and 3.30 points under full fine-tuning, with larger benefits when downstream labels are scarce. GeoNIRS also remains robust when input channels are missing. Geometry perturbations and pretraining ablations further demonstrate that both channel geometry and cross-chromophore reconstruction contribute to the learned representations. Overall, GeoNIRS provides an open and reproducible framework for transferable representation learning across heterogeneous fNIRS datasets.

Primary area:
unsupervised, self-supervised, semi-supervised, and supervised representation learning
Keywords:
fNIRS, foundation models, heterogeneous datasets, representation learning, cross-task transfer, neural decoding

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_c19GOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

GeoNIRS studies pretraining across fNIRS datasets with different probe layouts and channel counts.

For each channel, the model receives the measured signal together with source-detector coordinates. These channel-wise representations are compressed into a fixed latent space. HbO and HbR keep separate signal streams. During pretraining, masked portions of one chromophore are reconstructed using the other stream and the visible context.

GeoNIRS-base uses eight pretraining datasets. The larger version uses 22. The eight downstream datasets are excluded from both pretraining sets.

On the main benchmark, full fine-tuning gives 63.54 average balanced accuracy. Linear probing gives 63.06. The strongest non-GeoNIRS entry in Table 1 is 61.73.

The paper includes a random-initialization comparison and a version trained without geometry. Reduced-label adaptation and missing-channel robustness are examined separately.

The cross-task benchmark is encouraging. The point requiring the closest scrutiny is whether coordinates collected under different probe conventions actually provide the common spatial reference assumed by GeoNIRS.

Critical strengths

The separation between pretraining and downstream datasets is a strong aspect of the evaluation. None of the eight downstream datasets is included in the pretraining corpus.

The random-initialization control is useful. Under linear probing, average balanced accuracy changes from 58.94 to 63.06 after pretraining. Under full fine-tuning, the corresponding comparison is 60.25 versus 63.54. The gain cannot be explained by architecture alone.

The frozen-backbone experiment is informative as well. GeoNIRS-LP reaches 63.06 without updating the pretrained encoder and remains above the reported non-GeoNIRS baselines on the task average.

The geometry experiments are more extensive than a single perturbation test. Retraining without geometry reduces the average result from 63.34 to 60.36 across the three adaptation settings. Corrupting geometry at inference causes a further performance drop.

The reduced-label result is useful. With 10% of the labels, GeoNIRS-FT reports 60.70 balanced accuracy, versus 55.98 from random initialization.

Missing-channel robustness is relevant for fNIRS. At 50% channel loss, GeoNIRS degrades less than several of the comparison methods.

Code and pretrained checkpoints are available for anonymous review, which is a useful contribution to reproducibility.

Critical weaknesses

The main methodological concern is the interpretation of the geometry input across datasets. GeoNIRS converts coordinates into common physical units, applies a fixed scale, and centers each probe. These steps remove differences in units and translation, but they do not align arbitrary coordinate frames. Two probes can cover comparable cortical regions while being stored under different rotations or reflections, in which case their midpoint coordinates and source-detector direction vectors differ even though their physical arrangement relative to the head is similar. This is especially important because the direction vector is explicitly part of the geometry representation. The manuscript does not describe an anatomical registration that maps all probes into a shared head coordinate system, and the current representation is not rotation invariant. The mixture of planar and three-dimensional layouts adds another layer of inconsistency because depth coordinates are structurally absent for some datasets but meaningful for others.

The ablation results establish that GeoNIRS uses geometry, but they do not yet establish what information within the geometry produces the gain. Removing geometry during pretraining lowers average performance by about three points, which is useful evidence. However, probe geometry is usually stable within a dataset, so the coordinate pattern can also act as a cue for probe configuration or acquisition source. A network could exploit this dataset-specific structure during multi-dataset training without learning anatomical correspondence in the stronger sense claimed by the paper. The zero-coordinate and shuffled-coordinate experiments do not separate these possibilities because both interventions disrupt an input the pretrained model expects. A stronger attribution test would replace physical coordinates with a learned probe-layout identifier while keeping the remaining architecture fixed. A rigid rotation of the complete probe coordinates would also reveal whether the model depends on arbitrary coordinate axes rather than invariant spatial relationships.

The statistical presentation of the main benchmark could also be stronger. Results are averaged over five subject-level folds and two random seeds, and standard deviations are shown in several tables, but the principal GeoNIRS-versus-baseline comparisons do not include paired uncertainty. The two seeds use the same fold definitions, and the cross-validation training sets overlap across folds, so the ten fold-seed outcomes should not be interpreted as ten independent replications. This matters because several headline differences are around one or two percentage points: GeoNIRS-LP reaches 63.06 on average, Jung-MAE-LoRA reaches 61.73, and GeoNIRS-FT reaches 63.54. Reporting matched per-task or per-fold differences with confidence intervals would make the strength of these improvements much easier to assess.

The task-average gains also conceal substantial heterogeneity. Semantic decoding remains near chance, with GeoNIRS-FT at 51.03 balanced accuracy. In the same task, random initialization gives 51.52, so pretraining does not improve every downstream problem. The cross-chromophore ablation shows a similar pattern. Cross-reconstruction improves the overall average, but the largest gains occur on ICH and Tinnitus, while several tasks change little. On Action Mode, self-reconstruction is higher under all three reported adaptation settings. A leave-one-task-out analysis would help determine how strongly the aggregate advantage depends on the tasks with the largest effects. The physiological interpretation should also remain narrow because HbO and HbR can share systemic or acquisition-related variation in addition to task-related hemodynamic structure.

The comparison with prior fNIRS pretraining is another limitation. Jung-MAE is reconstructed from the published description because the original implementation and pretrained checkpoint are unavailable. The comparison is still useful, but it evaluates the authors' Jung-inspired implementation rather than the original system itself. Capacity also differs substantially: GeoNIRS-base has approximately 6.5M parameters, whereas the Jung-inspired model has approximately 2.0M. The internal w/o-Geometry control helps with attribution, but an external channel-independent pretraining baseline closer to GeoNIRS in model size would provide a cleaner test of the geometry-aware contribution.

The missing-channel experiment is relevant, but it does not yet isolate geometry as the reason for robustness. Channel removal is applied only at inference, after all downstream models have been trained with complete inputs. The experiment therefore demonstrates tolerance to missing channels rather than adaptation to naturally heterogeneous recording-level layouts. The cleanest attribution test would apply the same 10%, 25%, and 50% channel-loss protocol to the w/o-Geometry checkpoint. The downstream benchmark also uses a frozen common-channel tensor within each dataset, which keeps model comparison controlled but removes part of the recording-specific channel variation that motivates the framework. The current evidence therefore supports transfer across dataset-level layouts more directly than adaptation to arbitrary per-recording channel configurations.

The GeoNIRS-large experiment is difficult to interpret as scaling evidence. GeoNIRS-base uses 6.5M parameters and eight pretraining datasets, whereas the large configuration uses 30.1M parameters and 22 datasets. Average balanced accuracy moves only from 63.54 to 63.84, while ICH decreases from 80.86 to 78.07 and CI Status also drops slightly. Because capacity and corpus composition change together, the source of the 0.30-point average increase cannot be isolated. The result is informative as a description of the larger configuration, but not yet as evidence for a reliable scaling trend. The smaller one-, four-, and five-dataset study has the same limitation because dataset composition changes with corpus size and the analysis is restricted to one downstream task.

Finally, the scope of the method is narrower than the phrase “heterogeneous fNIRS datasets” may initially suggest. The authors screened many public datasets, but only 30 provided both usable signals and enough spatial metadata to recover geometry. GeoNIRS therefore currently applies to heterogeneous fNIRS datasets with sufficiently reliable source-detector coordinates. Datasets lacking those coordinates remain outside the demonstrated setting, which limits how broadly the present framework can be used without an additional geometry-missing mechanism.

Questions for authors

Are all probe coordinates expressed in one common anatomical coordinate frame before they are supplied to GeoNIRS?

If not, how are rotations or reflections between dataset coordinate systems handled?

What happens when the coordinates of an entire probe are rigidly rotated while its channel-to-signal correspondence remains unchanged?

Can physical coordinates be replaced by a learned probe-layout identifier while keeping the rest of the architecture fixed?

Can paired uncertainty be reported for the main GeoNIRS-versus-Jung-MAE comparison?

How does the average cross-reconstruction advantage change when ICH is excluded? What is the result after excluding both ICH and Tinnitus?

Can the channel-loss experiment be repeated using the w/o-Geometry checkpoint?

Does GeoNIRS still show an advantage when downstream recordings retain their native channel availability instead of using a common frozen channel tensor?

Can a channel-independent pretraining baseline with capacity closer to GeoNIRS-base be evaluated?

Can the 30.1M-parameter architecture be pretrained using only the original eight-dataset corpus?

Can the 22-dataset corpus be used with the 6.5M-parameter model?

Would a geometry representation based on invariant distances or anatomically registered positions change the results?

3 comments
AuthorsOpenReview ↗

Additional analyses on coordinate frames, geometry attribution, robustness, and evaluation scope

1. Cross-dataset coordinate frames

Thank you for raising this important issue. Coordinates were already converted to mm, centered per recording, and normalized using a fixed scale. Metadata/fiducial audit indicates RAS-style axes in all eight pretraining datasets, but differing origins (relative to (LPA+RPA)/2). These steps do not anatomically register probes. We will clarify that GeoNIRS uses within-recording relative source–detector/probe-layout geometry. Future work will map probes to a common frame using shared scalp fiducials and MRI/MNI registration where available, then reevaluate pretraining.

2. Geometry attribution

We appreciate the concern that the original ablation does not isolate which geometric information accounts for the gain. We added a learned probe-layout ID control: one learnable 6D vector per layout, shared across its channels, replaces physical geometry; other settings match GeoNIRS-base. Table 1 reports eight-task mean BA (%); Δ=Learned ID−GeoNIRS-base.

AdaptationGeoNIRS-baseLearned probe-layout IDΔ (pp)
LP63.161.0−2.1
LoRA63.460.3−3.1
FT63.560.5−3.0

GeoNIRS-base performs better under all three protocols, suggesting layout identity alone does not explain the full gain.

3. Paired uncertainty

We added matched comparisons with MOMENT and Jung-MAE. Since both seeds use the same subject-level folds, we averaged them within each fold before computing paired differences. Estimates are in our response to Reviewer 2km3, Comment 1.

4. Task heterogeneity

We added leave-one-task-out (LOTO) analysis, recomputing equal-weight means over the remaining seven tasks after each exclusion. Pretraining averages LP/FT; cross-reconstruction averages FT/LoRA/LP. Values are BA differences (pp).

AllICHCITinnitusPainEmotionSemanticMotorAction
Pretraining+3.71+3.40+3.78+3.44+3.80+3.67+4.18+3.84+3.58
Cross-reconstruction+1.58+0.64+1.80+1.20+1.75+1.60+1.81+1.81+2.03

Both gains remain positive after any single-task exclusion, though contributions vary; excluding ICH reduces the cross-reconstruction gain. We will distinguish task averages from task-level outcomes and avoid implying universal improvements. Cross-chromophore reconstruction tests predictive structure between HbO and HbR, which may also reflect shared systemic or acquisition-related variation.

5. Jung-inspired MAE

We appreciate the opportunity to clarify. As original code and checkpoint were unavailable, we evaluated a paper-guided Jung-inspired implementation. The initial model matched GeoNIRS in encoder/decoder depth and width, but not parameter count. We retrained a channel-independent, capacity-matched version (~6.5M parameters). Results are in our response to Reviewer 2km3, Comment 2. GeoNIRS-base retains higher average performance, so parameter count alone does not explain the gap.

6. Missing-channel robustness

We agree the original experiment did not isolate geometry as the source of robustness. It tests inference-time channel-loss tolerance after downstream training with complete channels. We applied the same 10%, 25%, and 50% loss protocol to the w/o-Geometry checkpoint; GeoNIRS showed no clear robustness advantage over this control. We will remove the geometry-based explanation and retain only that GeoNIRS performs favorably relative to non-GeoNIRS baselines under inference-time channel loss. This does not establish adaptation to naturally varying recording-level layouts.

7. Scaling analysis

We agree Base–Large changes both model capacity and corpus composition; its +0.30-point mean gain cannot be attributed to either alone. We will report it in the Supplementary Material as the larger configuration's result. Separately, we fixed GeoNIRS-base (6.5M parameters) and varied the corpus from 5 to 8 datasets. The four configurations represent ~12%, 28%, 30%, and 100% of pretraining hours; FT mean BA across eight tasks was 61.06%, 61.51%, 61.63%, and 63.54%. We will present this as corpus-size sensitivity: performance rises across tested nested configurations, without attributing the trend to dataset count alone.

8. Scope and geometry metadata

We appreciate the point about scope. GeoNIRS requires spatial metadata sufficient to recover channel geometry. Of ~100 public datasets screened, 30 met our criteria. In our check of 10 public fNIRS dataset papers in Scientific Data (2024–2026), 9 provided explicit spatial information; we therefore do not consider this requirement to severely restrict practical use. Missing coordinates also limit localization and cross-study comparison. fNIRS best practices recommend reporting source/detector positions relative to head landmarks; NIRS-BIDS supports measured or standard-space coordinates, helping data reuse and cross-dataset modeling.

AuthorsOpenReview ↗

Coordinate Harmonization Across Datasets and Updated Downstream Results

We appreciate the reviewer’s concern about geometric consistency across datasets. Following the preliminary tests described in our previous response, we further investigated this important issue. After checking the coordinate sources for each dataset, we developed a procedure to harmonize their spatial representations. Specifically, we define the origin as the midpoint between the left and right preauricular landmarks and adopt RAS-like axes (+X right, +Y anterior, +Z superior), with all coordinates expressed in millimeters. For recordings providing LPA, RPA, and nasion landmarks, we construct the coordinate axes from these three points and apply rotation and translation. For template-based coordinates or datasets providing only planar layouts, we use publicly available template fiducials, supplementary three-dimensional coordinates, or explicitly identified approximate reconstructions. Dataset-specific procedures are summarized in Table 1.

Table 1. Coordinate sources and harmonization procedures.

StageDatasetGeometric information and coordinate harmonization
PretrainingDS21, DS29, DS31, DS32, DS33, DS34Align each recording using its three-dimensional optode coordinates and LPA/RPA/Nz landmarks through rotation and translation.
PretrainingDS28Match optode coordinates to the MNE standard_1005 template and align using the corresponding template fiducials.
PretrainingDS35Align MNI152NLin2009bAsym template coordinates using the landmarks provided in the recording.
DownstreamDS7 (ICH)Use the three-dimensional MNI optode coordinates published in the paper, provisionally aligned using ICBM152/Cutini template fiducials.
DownstreamDS47 (CI Status)Align individually digitized three-dimensional optode coordinates using recording-specific LPA/RPA/NAS landmarks and convert meters to millimeters.
DownstreamDS36 (Tinnitus)Align the three-dimensional optode coordinates stored in SNIRF files using their embedded LPA/RPA/Nz landmarks.
DownstreamDS19 (Pain Intensity)Align the published MNI channel coordinates using Colin27 fiducials and approximately reconstruct optode endpoints from the planar probe layout and scalp projection.
DownstreamDS8 (Motor Recovery)Align the three-dimensional optode coordinates stored in SNIRF files using their embedded LPA/RPA/Nz landmarks.
DownstreamDS42 (Action Mode)Transform the mean three-dimensional optode coordinates provided in the supplementary material according to the inferred AtlasViewer/Colin27 frame, then align using template fiducials.

All coordinates are expressed in millimeters with RAS-like axes (+X right, +Y anterior, +Z superior) and the origin at the midpoint between the preauricular landmarks, (LPA + RPA) / 2.

This procedure harmonizes coordinate origins, axis orientations, and units. After coordinate harmonization, we pretrained GeoNIRS again and evaluated it using the original downstream splits and evaluation protocols. Balanced accuracy, averaged equally across the six tasks, increased from 65.89%, 66.16%, and 66.36% to 66.70%, 67.70%, and 67.54% under LP, LoRA, and FT, respectively, corresponding to improvements of 0.81, 1.54, and 1.17 percentage points. LoRA improved on all six tasks. Taking the best-performing GeoNIRS adaptation setting for each task, the updated model ranked first on five tasks and second on Pain Intensity. These results support the practical value of further harmonizing coordinate representations across datasets; the complete changes are reported in Table 2. Coordinate verification and conversion for the remaining two downstream tasks are still being finalized. We therefore report six tasks in this update and compare against the original results on exactly the same task set.

Table 2. Balanced accuracy (%) before and after coordinate harmonization.

Downstream taskLP original → updatedΔ (pp)LoRA original → updatedΔ (pp)FT original → updatedΔ (pp)Updated GeoNIRS best rank
ICH77.82→79.02+1.2080.10→81.26+1.1680.86→79.26−1.601
CI Status68.06→69.84+1.7869.53→70.76+1.2369.19→71.09+1.901
Tinnitus58.70→63.41+4.7158.72→62.84+4.1257.70→61.41+3.711
Pain Intensity56.19→52.96−3.2354.36→55.50+1.1454.70→55.09+0.392
Motor Recovery64.27→64.56+0.2963.92→64.71+0.7964.75→65.85+1.101
Action Mode70.29→70.41+0.1270.34→71.16+0.8270.99→72.51+1.521
Six-task average65.89→66.70+0.8166.16→67.70+1.5466.36→67.54+1.171
AuthorsOpenReview ↗

Rigid-rotation sensitivity analysis

Rigid-rotation sensitivity analysis

We thank the reviewer for suggesting a rigid-rotation test to examine whether GeoNIRS depends on coordinate-frame orientation. We had initially deferred this evaluation because of computational constraints, but have now added it. We used the same checkpoint pretrained in the unified coordinate frame and applied a shared random 3D rotation of 120° to each channel’s complete 6D geometry representation, rotating both the channel midpoint (x, y, z) and the source–detector direction vector (Δx, Δy, Δz). The same rotation was used across all six downstream tasks, folds, seeds, and adaptation protocols. We then followed the original downstream adaptation and evaluation protocols and paired the results with those obtained using the same checkpoint and data splits without rotation. Table 1 reporRigid-rotation sensitivity analysists changes in BAcc, defined as rotated minus unrotated performance.

Table 1. Change in BAcc after rigid rotation relative to the unrotated results (percentage points).

Downstream taskLP ΔBAcc (pp)LoRA ΔBAcc (pp)FT ΔBAcc (pp)
DS7 ICH−10.17−9.04−4.76
DS47 CI Status−0.90+1.55+0.07
DS36 Tinnitus+0.91−0.66−3.19
DS19 Pain−0.23−2.33−2.22
DS8 Motor Recovery−3.02−3.38−1.56
DS42 Action Mode−2.33−1.38−1.11
Six-task average−2.62−2.54−2.13

Across the six tasks, equally weighted mean BAcc decreased by 2.62, 2.54, and 2.13 pp for LP, LoRA, and FT, respectively. Macro-F1 decreased by 2.88, 2.73, and 2.07 pp, and AUROC by 3.45, 2.38, and 2.28 pp, respectively. BAcc decreased on five of the six tasks under each adaptation protocol. These results indicate that downstream performance is somewhat sensitive to coordinate-frame orientation, although the effect varies across tasks and adaptation protocols. Together with the geometry-free control that preserves channel-index identity, this analysis tests whether channel identity alone accounts for the observed gains and whether the model is sensitive to coordinate orientation.

Reviewer_sfSWOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
3
Read review
Paper summary

The paper proposes GeoNIRS, a self-supervised pretraining framework for fNIRS data, that is mindful in handling possible channel counts and probe layouts across the dataset. The main idea is to replace channel-index correspondence with physical source–detector geometry. Each fNIRS channel is represented using its spatial location and source–detector configuration, and a geometry-aware channel compressor maps a variable number of physical channels into a fixed number of latent-channel tokens. GeoNIRS is further pretrained using bidirectional HbO/HbR cross-chromophore reconstruction with masking.

Critical strengths

The paper aims to address a practical problem in pooling multiple fNIRS dataset: the different datasets might have different probe layouts and channel counts. Using physical source–detector geometry to to establish correspondence seems reasonable.

The experimental section is also strong. In particular, the eight downstream datasets are completely excluded from pretraining, providing a clean cross-dataset and cross-task transfer evaluation.

Critical weaknesses
  1. The methodological novelty is limited. While the geometry-aware design is well suited for the particular problem pooling possibly heterogeneous fNIRS dataset. The overall pretraining strategy is pretty standard. The masked cross-modal/signal reconstruction are largely established.
  2. The experiments show that the proposed model outperforms the evaluated baselines, but they provide relatively limited additional insight beyond findings that are already well established in the field. For example, the observation that pretraining is more beneficial when downstream labels are scarce is expected for a pretraining method paper, and the improvement observed when increasing model or pretraining-data scale is also unsurprising. These experiments are useful for validating the framework, but they are largely confirmatory rather than revealing new behavior.
Questions for authors

NA

1 comment
AuthorsOpenReview ↗

Clarifying GeoNIRS’s methodological contribution and the scope of its experiments

Thank you for the thoughtful assessment and helpful suggestions.

1.Methodological contribution and relation to prior work

We appreciate your recognition that geometry-aware modeling is well suited to joint learning from heterogeneous fNIRS datasets. We agree that masked reconstruction is an established pretraining paradigm, and we do not claim cross-signal reconstruction in general as a methodological novelty. Rather, our contribution is a framework tailored to heterogeneous fNIRS pretraining, combining geometry-aware channel compression with bidirectional cross-chromophore reconstruction.

Existing fNIRS studies use different strategies to incorporate hemoglobin signals. EFRM learns modality-specific representations for EEG and fNIRS and aligns them through contrastive learning [1]. Wu et al. combine HbO, HbR, and HbT as a unified input processed by temporal and spatial branches [2], while fNIRSNET evaluates joint HbO/HbR inputs formed by concatenation along the depth or channel dimension [3]. These examples illustrate that using both chromophores does not itself require cross-reconstruction. Joint-input approaches allow the model to learn from the signals together, whereas our objective explicitly trains each chromophore representation to predict the other. We combine this objective with bidirectional reconstruction and contiguous temporal masking, and evaluate it against self-reconstruction to assess its benefits and task-dependent limitations.

2.Scope and interpretation of the experiments

We agree that the label-efficiency and scaling trends are not novel general findings. These analyses test whether expected benefits of pretraining hold in our specific setting: joint pretraining on heterogeneous fNIRS datasets, with all downstream datasets excluded from pretraining. We therefore view them as validation of GeoNIRS in this setting, rather than as evidence for new general laws of label efficiency or scaling.

The other experiments examine complementary, setting-specific questions. The channel-loss analysis evaluates whether GeoNIRS degrades less than the baselines under the tested channel-loss perturbations; it is not intended to show that geometry causes this robustness or that the experiment fully represents naturally varying probe layouts. The geometry-perturbation experiment keeps the signals fixed while altering the spatial metadata, thereby assessing sensitivity to the reliability of geometric information. The comparison between target-domain self-supervision and cross-dataset pretraining helps distinguish gains from self-supervised learning on target data from gains associated with using additional datasets for pretraining. Finally, the cross-reconstruction versus self-reconstruction comparison tests whether predicting the complementary chromophore benefits transfer, while task-level variation makes clear that an average improvement does not imply gains on every task.

We will revise the presentation to distinguish validation of expected pretraining benefits from analyses of channel-loss robustness, sensitivity to spatial metadata, the contribution of cross-dataset pretraining, and task-dependent effects.

[1] Jung, E., & An, J. (2025). EFRM: A Multimodal EEG–fNIRS Representation-learning Model for few-shot brain-signal classification. Computers in Biology and Medicine, 199, 111292. https://doi.org/10.1016/j.compbiomed.2025.111292

[2] Wu, Y., Mu, T., Qu, S., Li, X., & Li, Q. (2025). A dual-branch deep learning model based on fNIRS for assessing 3D visual fatigue. Frontiers in Neuroscience, 19, 1589152. https://doi.org/10.3389/fnins.2025.1589152

[3] Pandey, P., McLinden, J., Rahimi, N., Kumar, C., Shao, M., Spencer, K. M., Ostadabbas, S., & Shahriari, Y. (2024). fNIRSNET: A multi-view spatio-temporal convolutional neural network fusion for functional near-infrared spectroscopy-based auditory event classification. Engineering Applications of Artificial Intelligence, 137, 109256. https://doi.org/10.1016/j.engappai.2024.109256

Reviewer_2km3OpenReview ↗
Rating
3
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

GeoNIRS is a pretraining framework for heterogeneous fNIRS data. It combines source–detector geometry, latent-channel compression, and bidirectional HbO/HbR reconstruction to accommodate different channel counts and probe layouts. The main model is pretrained on eight datasets, with a larger configuration using 22 datasets evaluated separately. Experiments cover eight held-out downstream datasets using subject-disjoint five-fold cross-validation and two seeds. The paper reports improvements over evaluated baselines and random initialization, supported by label-efficiency, missing-channel, and component-ablation experiments.

Critical strengths

The framework addresses an important practical obstacle to multi-dataset fNIRS pretraining. Geometry-aware channel compression provides a coherent way to process heterogeneous probe layouts. Evaluation on eight datasets excluded from pretraining directly supports the practical relevance of this approach. Controlled comparisons support the value of pretraining. Compared with the same randomly initialized architecture, pretraining improves average balanced accuracy by 4.12 percentage points under linear probing and 3.30 points under full fine-tuning. The frozen-backbone results are particularly useful evidence of transferable representations.

Critical weaknesses
  1. Uncertainty in the principal performance gains is insufficiently quantified. The authors report means, standard deviations, and matched comparisons, but no formal significance tests or confidence intervals for the principal improvements. The matched gains over Jung-inspired MAE are 2.38 points under linear probing and 1.69 under LoRA. Paired uncertainty estimates accounting for repeated cross-validation would strengthen confidence in these advantages.
  2. The geometry ablation does not fully isolate the contribution of spatial information. Coordinates are removed from both compression keys and decoder queries. Under the stated query formulation, this may also remove output-channel identity unless another channel-specific mechanism remains. The ablation therefore supports the usefulness of the complete geometry-based design, but provides less precise evidence about the source of that benefit. An identity-preserving control would clarify this attribution.
Questions for authors
  1. Can you report paired confidence intervals or appropriate significance tests for the main baseline comparisons, explaining how dependence across repeated cross-validation results is handled?
  2. What are the principal implementation differences, pretraining data/budget, and tuning procedures for Jung-inspired MAE? What considerations determined the exclusion of the additional baselines mentioned above?
  3. After removing geometry, what distinguishes decoder queries for different physical channels? Would the conclusion hold when channel identity is preserved in the ablated model?
  4. Why was 5 Hz selected, and what resampling algorithm? Appendix B.1.1 states that valid segments are resampled, but does not specify these details.
3 comments
AuthorsOpenReview ↗

Clarifications on paired uncertainty, Jung-MAE, geometry ablations, and 5-Hz resampling

1. Paired uncertainty estimates

Thank you for noting that uncertainty in the main results was insufficiently quantified. We compare GeoNIRS with two relevant pretrained baselines: Jung-inspired MAE (fNIRS-specific) and MOMENT (general-purpose time series).

The two seeds share subject-level folds. We therefore averaged seeds within each fold before computing matched GeoNIRS–baseline differences and did not treat the ten fold–seed outcomes as independent. Task-level fold intervals use Nadeau–Bengio corrected resampled-t intervals to account for overlapping training sets. Cross-task mean CIs are paired t intervals across the eight task-level differences; p-values are two-sided Wilcoxon signed-rank tests across tasks. Table 1 reports the aggregate results.

Table 1. Paired comparisons in balanced accuracy (pp).

ComparisonMean difference (95% CI)Wilcoxon p
GeoNIRS-LP vs. Jung-MAE-LP+2.38 [0.18, 4.58]0.0234
GeoNIRS-LoRA vs. Jung-MAE-LoRA+1.69 [−0.09, 3.47]0.0781
GeoNIRS-LP vs. MOMENT-LP+3.07 [1.10, 5.04]0.0078
GeoNIRS-LoRA vs. MOMENT-LoRA+3.25 [0.42, 6.08]0.0391

All estimated mean differences favor GeoNIRS; however, the CI for LoRA versus Jung-MAE includes zero, so we do not interpret it as conclusive evidence of an advantage.

2. Jung-inspired MAE implementation and comparison

We implemented Jung-inspired MAE from the published description because we could not identify official code or pretrained weights. We followed the reported MAE setup (50% random patch masking, visible-patch encoding, and MSE reconstruction). For unspecified details—heterogeneous-channel handling, signal organization, and architecture—we used channel-independent processing with shared encoder/decoder parameters, joint HbO/HbR temporal patches, and fixed temporal positional embeddings.

Both models used the same GeoNIRS-base corpus and preprocessing, including the same 30-s windows, 150 pretraining epochs, data splits, and downstream search/model-selection protocol. Downstream training used 30 epochs and identical task-specific search ranges. The initial Jung-inspired model used the same encoder/decoder depth and width as GeoNIRS-base but had 2.03M parameters, versus 6.51M. To control for capacity, we trained a matched version with four encoder and two decoder layers, increasing widths from 192 to 304 and from 96 to 284, respectively. GeoNIRS-base had higher average BAcc across all three adaptation protocols (Table 2).

Table 2. Average BAcc across eight tasks (%).

ProtocolGeoNIRS-baseCapacity-matched Jung-MAEΔ (pp)
LP63.0660.92+2.14
LoRA63.4261.36+2.06
FT63.5461.40+2.14

Appendix Table 13 summarizes related methods and their pretraining scope, layout handling, and code/weight availability. These methods target different modalities, tasks, or transfer settings and do not provide a directly matched benchmark for joint pretraining across heterogeneous layouts and cross-task evaluation. We will clarify these inclusion criteria in the revision.

3. Geometry ablation preserving channel identity

We added a geometry-free control that preserves channel-index identity. It removes the coordinate encoder and uses no coordinates, source–detector pairs, distances, adjacency, or dataset/layout IDs. Instead, all datasets share a learnable 512 × 192 channel-index table; the first C rows are added to encoded channel-aggregation features and decoder queries. The model is pretrained from scratch with GeoNIRS-base settings.

Table 3. Average BAcc across eight tasks (%).

AdaptationGeoNIRS-baseNo geometry + channel-index embeddingsΔ (pp)
LoRA63.4262.74−0.68
FT63.5462.15−1.39

Channel-index identity alone does not recover GeoNIRS-base's average performance; under FT, the control is lower on all eight tasks. We will include this control to distinguish channel identity from physical geometry and make the ablation fairer.

4. Common sampling rate

Because original sampling rates vary across datasets and systems, we resampled HbO/HbR to 5 Hz for a common input grid. Prior work describes common-rate resampling for multisite fNIRS and reduced computational/memory costs from downsampling [1]. fNIRS studies have used 5 Hz [2] and 7 Hz, with 4–10 Hz reported as a common downsampling range [3]. These precedents support rate harmonization but do not establish 5 Hz as optimal; we chose it as a practical common rate, not as a universal optimum.

References

[1] Hou, X., Zhang, Z., Zhao, C., Duan, L., Gong, Y., Li, Z., & Zhu, C. (2021). NIRS-KIT: A MATLAB toolbox for both resting-state and task fNIRS data analysis.

[2] Kothe, C., Hanada, G., Mullen, S., & Mullen, T. (2024). On decoding of rapid motor imagery in a diverse population using a high-density NIRS device.

[3] Guglielmini, S., Banchieri, V., Scholkmann, F., & Wolf, M. (2025). Transformer-based deep learning model for predicting fNIRS short-channel signals.

AuthorsOpenReview ↗

5-Hz Resampling Procedure

We thank the reviewer for noting that Appendix B.1.1 states that valid segments are resampled but does not specify the algorithm or implementation details. We clarify them here. We resampled HbO and HbR separately to 5 Hz along the time axis using SciPy’s scipy.signal.resample_poly (polyphase FIR resampling). Each continuous valid segment was processed independently using a low-pass FIR filter with a Kaiser window (β = 5.0) and linear-trend boundary extension (padtype="line"). The two chromophores used the same temporal mapping, and standardization was performed after resampling.

Thank you for your detailed response. The paired statistical analysis employed, along with the additional control measure using channel indices, has addressed my concerns. For now, I maintain my recommendation of "weak acceptance."

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.