- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents NOIR, a framework that reframes core medical imaging tasks (such as segmentation, shape completion, image-to-image translation, and image synthesis) as continuous operator learning between function spaces rather than traditional discrete grid-based learning. NOIR embeds discrete medical signals into Implicit Neural Representations (INRs) using shared dataset-level parameters and signal-specific latent modulations, and trains a Neural Operator (NO) to map between their latent spaces. The authors evaluate NOIR across five datasets in both 2D and 3D downstream tasks and provide empirical validation of its -ReNO properties, demonstrating resolution-independent performance.
Critical strengths
The paper formulates supervised medical imaging tasks as mappings between INR-parameterized function spaces. This formulation is well motivated by the variability in spatial sampling and the frequent resampling of medical images, and makes discretization sensitivity an explicit consideration in model design.
The evaluation establishes the applicability of this method to segmentation, shape completion, image translation, and synthesis across five datasets. Covering both 2D and 3D settings, with comparisons against several architectural families, gives the medical-imaging application study substantive empirical breadth.
The cross-resolution experiments demonstrate stable segmentation performance and consistent latent representations across the evaluated input discretizations. These findings support the empirical value of the continuous representation for handling resolution changes without retraining the shared model parameters.
Critical weaknesses
- High Test-Time Optimization Overhead: Unlike standard feed-forward networks, NOIR requires test-time latent optimization (inner-loop gradient steps) for every new test sample. This leads to a significantly slower inference time (e.g., 1.58 seconds for fastMRI tasks), which undermines its practicality for high-throughput clinical workflows or real-time applications.
- Fidelity Gap in High-Dimensional Tasks: The fidelity ceiling analysis (Section 4.6) reveals a substantial gap between the output INR's theoretical reconstruction capacity and NOIR's actual end-task performance, particularly in high-dimensional tasks like fastMRI translation (PSNR 29.09 vs. 22.87). This indicates that learning the latent-to-latent mapping becomes a major bottleneck when scaling to complex high-dimensional medical data with limited paired training samples.
- Limited Native-Resolution Advantage: While NOIR excels in resolution-independent robustness, its performance at native full resolution is often comparable to or slightly below traditional task-specific models (such as U-Net or diffusion-based models) while demanding considerably higher computational complexity during testing.
Questions for authors
- For fastMRI, what evidence supports attributing the gap between direct output-INR reconstruction (29.09 dB) and NOIR prediction (22.87 dB) to latent dimensionality and limited training data? Since Table 5 evaluates alternative latent-mapping models only on segmentation, how do you distinguish mapping limitations from input representation error in this task?
- Does the reported inference time include output-INR decoding on the evaluation grid, in addition to latent fitting and the operator forward pass? What latency requirements underlie the statement in Section 4.5 that the method is compatible with near-real-time clinical use?
- Alternative Operator Architectures: Beyond residual MLPs, have the authors explored more expressive modern neural operator backbones to better handle high-dimensional latent spaces?