- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The work proposes a spatial field reconstruction method for onboard deployment. The work uses an existing U-Net architecture with its bottleneck changed. A decoupled dual branch bottleneck is proposed with separate spatial and spectral branches, where the spectral branch is supervised by a frozen spectral neural operator. Experiments are shown on AirfRANS, Three-cylinder flow and Turbulent channel flow with parameters, FLOPS and Inference time is given for all 3 datasets strengthening edge device applicable robustness. Ablations are provided with various settings of the proposed model to support contribution of each component.
Critical strengths
- The edge device deployment problem is of high practical relevance and is also supported with evidence.
- The paper is clearly written and very easy to read and follow and architectural improvements are supported by ablations.
Critical weaknesses
- The work is a combination of existing papers or components from different papers rather than a novel contribution: Specifically U-REPA (NeurIPS 2025) and REPA-P (ICML 2026) are some of closely related papers, including applications to scientific domain.
- Claimed efficiency gain in abstract is not a fair comparison, as it largely reflects the choice of baseline: The reported 94% parameter reduction and around 84% lower inference latency than standard baseline are obtained by comparing SS-REPA (built on compact U-Net 0.86M) with Standard 13.39M parameter U-Net.
References:
- Tian, Y., Chen, H., Zheng, M., Liang, Y., Xu, C., & Wang, Y. (2026). U-repa: Aligning diffusion u-nets to vits. Advances in Neural Information Processing Systems, 38, 11003-11024.
- Jia, H., Yin, P., Chen, W., Liang, S., Wang, L., Tian, B., ... & Yue, Y. (2026). Learning to Think in Physics: Breaking Shortcut Learning in Scientific Diffusion via Representation Alignment. arXiv preprint arXiv:2605.20780.
Questions for authors
- Have the authors compared SS-REPA against a parameter-matched UNet (around 0.86M) with a standard convolutional bottleneck? Reported Standard U-Net small is (0.5 M parameters from Figure 2) which seems not a fair ablation.
- Could the authors compare SS-REPA against conventional feature-level and output-level knowledge distillation using the same RecFNO teacher and compact student backbone?
- The Gaussian bandwidth is fixed at σ = 0.5 throughout the experiments. How sensitive is the performance to this choice?
- Since the method aims onboard sparse-sensor reconstruction, how robust is SS-REPA to sensor noise, missing sensors, and changes in sensor placement?
- Could the authors report mean ± standard deviation over multiple seeds ?
- Given that SS-REPA targets sparse-sensor physical-field reconstruction, could the authors extend their comparisons to recent latent neural operators (LNOs) and implicit neural representation methods, particularly MMGN (ICLR 2024), SIREN, and WIRE (CVPR 2023)?
References:
- Wang, T., & Wang, C. (2024). Latent neural operator for solving forward and inverse pde problems. Advances in Neural Information Processing Systems, 37, 33085-33107.
- Luo, X., Xu, W., Nadiga, B. T., Ren, Y., & Yoo, S. (2024, May). Continuous field reconstruction from sparse observations with implicit neural networks. In International Conference on Learning Representations (Vol. 2024, pp. 3281-3305).
- Sitzmann, V., Martel, J., Bergman, A., Lindell, D., & Wetzstein, G. (2020). Implicit neural representations with periodic activation functions. Advances in neural information processing systems, 33, 7462-7473.
- Saragadam, V., LeJeune, D., Tan, J., Balakrishnan, G., Veeraraghavan, A., & Baraniuk, R. G. (2023, June). Wire: Wavelet implicit neural representations. In 2023 IEEE/CVF conference on computer vision and pattern recognition (CVPR) (pp. 18507-18516). IEEE.
4 comments
Response to Official Comment by Authors
I thank the authors for the detailed rebuttal and substantial revision, many of my concerns got resolved. Considering the rebuttal, i still have some concerns:
- Novelty is incremental, authors tried to explain the differences from existing closely related methods, but that does not rule out incremental novelty issue.
- The abstract and contributions still report the 94% parameter and 83.4–85.5% latency reductions against the 13.39M UNet.
- Improvement of model over baselines is marginal and within noise, Considering Tables 6, 7 and 8 (seed robustness tests), gains over the strongest baselines are small relative to seed variance on AirfRANS and partly on turbulent channel flow.
Therefore, i retain my score.
Novelty: the contribution is a deployment-driven design, not a combination of existing components.
We thank the reviewer very much for the careful re-reading and for the constructive follow-up. Our responses to the three remaining points are as follows.
1. Novelty: the contribution is a deployment-driven design, not a combination of existing components.
We respectfully clarify that SS-REPA is not proposed as a generic accuracy-oriented architecture, but as a deployment-driven method for onboard sparse physical-field reconstruction under tight memory and latency budgets. This framing is not a niche motivation: the escalating memory, latency, and energy costs of deploying deep models on edge devices are widely recognized as a central bottleneck for edge AI, and this problem has been explicitly highlighted in leading venues.
Nature Communications (2025) states:
“Artificial intelligence (AI) has made significant strides towards efficient online processing of sensory signals at the edge through the use of deep neural networks with ever-expanding size. However, this trend has brought with it escalating computational costs and energy consumption, which have become major obstacles to the deployment and further upscaling of these models.”
Science (2022) similarly notes:
“Advanced machine learning models are currently impossible to run on edge devices such as smart sensors and unmanned aerial vehicles owing to constraints on power, processing, and memory.”
These statements reflect a broadly shared concern across the community rather than isolated observations: the deployment constraints of memory, latency, and energy are first-order obstacles, not secondary considerations. This is precisely the setting that motivates SS-REPA. References
-
Exploiting neuro-inspired dynamic sparsity for energy-efficient intelligent perception. Nature communication 2025.
-
Delocalized photonic deep learning on the internet‘s edge. Science 2022.
In this setting, accuracy is not the sole—or even the first-order—design criterion; memory footprint and inference latency are first-order requirements. The relevant question is whether a compact deployed model can retain accuracy comparable to much larger or stronger baselines after aggressive compression.
Our specific contributions are:
- a decoupled dual-branch bottleneck for a deployment-friendly convolutional encoder–decoder,
- selective alignment of only the spectral-context branch to a frozen spectral neural operator teacher, with the teacher discarded at inference.
The decoupled dual-branch bottleneck is a general, backbone-agnostic architectural component: it can be inserted into arbitrary convolutional encoder–decoder backbones, and the selective spectral alignment is a training-time add-on that leaves inference unchanged. To our knowledge, this decoupled dual-branch design with branch-level selective spectral alignment has not been proposed in prior work. More importantly, the ablation shows that neither component alone explains the result. Using the data in Table 1 and the ablation study:
UNet + decoupled dual-branch already reduces error relative to the parameter-matched Standard UNet (0.92M) by 2.4% / 34.1% / 17.8% on AirfRANS (8 sensors), Three-cylinder (4/cyl), and Turbulent (100 sensors), respectively.
UNet + alignment (i.e., the U-REPA-style single-branch model with alignment but without the decoupled dual-branch design) does not improve over the parameter-matched UNet on AirfRANS (−9.4%, i.e. worse), and is only marginally better on Three-cylinder (+1.1%) and Turbulent (+6.7%). Relative to UNet + decoupled dual-branch, it is actually 12.1% / 50.0% / 13.6% worse.
Thus, simply transferring an alignment mechanism to a single-branch compact model is insufficient. These results show that the gain is not a simple additive combination of existing components: the decoupled dual-branch architecture and the selective spectral-branch alignment are mutually necessary. The ablation therefore supports a design contribution, not an incremental stacking of known modules.
| Variant | AirfRANS (8) | Three-cyl. (4/cyl) | Turbulent (100) |
|---|---|---|---|
| Standard UNet (0.92M) | 0.297 | 0.091 | 0.359 |
| UNet + decoupled dual-branch | 0.290 | 0.060 | 0.295 |
| UNet + alignment | 0.325 | 0.090 | 0.335 |
| UNet + decoupled dual-branch (w/o mean-shift) | 0.281 | 0.075 | 0.304 |
| UNet + decoupled dual-branch + alignment (Full) | 0.251 | 0.043 | 0.231 |
- UNet + decoupled dual-branch + alignment vs. UNet + alignment: 22.8 / 52.2 / 31.0% lower error.
- UNet + alignment vs. UNet + decoupled dual-branch: −12.1 / −50.0 / −13.6% (worse).
On effective receptive field and long-range dependence. Figure 5 shows that the architectural improvement effectively enlarges the effective receptive field and strengthens long-range input–output dependence, which existing single-branch compact methods do not provide.
Fair comparison and marginal gains.
2. Fair comparison.
We thank the reviewer for this observation. We have revised both the abstract and the contributions to report two complementary comparisons rather than the efficiency numbers alone. We agree that these efficiency numbers are obtained relative to the 13.39M standard UNet and that they reflect this choice of baseline. We retain this comparison as a primary one because the paper targets onboard sparse-field reconstruction, where the standard UNet is the baseline conventionally considered for deployment, and the efficiency numbers directly quantify the end-to-end deployment cost relative to that reference. At the same time, the revision adds a parameter-matched baseline comparison to show that the accuracy advantage is not merely a consequence of capacity: relative to the parameter-matched baseline, SS-REPA reduces relative ℓ₂ error by 15.5% on AirfRANS-8, 52.7% on Three-cylinder, and 35.7% on Turbulent-100. These two comparisons answer different questions and are intended to complement each other.
3. Marginal gains and seed variance. We thank the reviewer for this careful reading of Tables 6–8. We agree that on AirfRANS and parts of the turbulent channel flow benchmark, the absolute accuracy gap over the strongest baselines is small and close to seed variance, and we do not claim that this gap is statistically decisive on every configuration. However, as also emphasized in our response to the novelty concern, SS-REPA is deployment-driven: under limited onboard deployment resources, accuracy is not the only—or even the first-order—design criterion; memory footprint and inference latency are first-order requirements. This point is more clearly illustrated in Figure 2, which presents the accuracy-efficiency trade-off across the three benchmarks. Although the absolute accuracy margin is modest on some configurations, SS-REPA consistently lies on the favorable side of the trade-off, achieving competitive reconstruction accuracy at substantially lower parameter count and inference latency. Judging the contribution solely by the accuracy margin is therefore incomplete and does not reflect the deployment-oriented objective of the paper.
Against the strongest accuracy baseline on each benchmark, SS-REPA reduces parameters by about 91–92%, FLOPs by 59.1–99.4%, and inference latency by 93.5–98.6%, while remaining competitive in accuracy. This is the deployment-relevant trade-off the paper targets, and we have made this framing more explicit in the revision.
Efficiency comparison against the strongest accuracy baseline per benchmark (lowest average error across sensor settings, excluding SS-REPA variants). Each cell shows baseline → SS-REPA (reduction). Inference time is ms/sample.
| Metric | AirfRANS vs. Senseiver | Three-cylinder vs. IRNO | Turbulent vs. GNO |
|---|---|---|---|
| Params (M) | 10.11 → 0.86 (−91.5%) | 10.57 → 0.86 (−91.9%) | 9.59 → 0.86 (−91.0%) |
| FLOPs (G) | 31.38 → 1.66 (−94.7%) | 5.52 → 2.26 (−59.1%) | 54.55 → 0.31 (−99.4%) |
| Latency (ms) | 53.46 → 3.47 (−93.5%) | 126.73 → 4.69 (−96.3%) | 59.26 → 0.81 (−98.6%) |
We hope this clarifies that the intended claim is not that SS-REPA dominates by a large accuracy margin, but that it achieves competitive accuracy at a small fraction of the deployed parameter and latency cost—the trade-off that matters for onboard deployment.
We sincerely thank the reviewer again for the detailed engagement.
W1: Novel contribution.
We thank the reviewer for raising this point and for pointing us to these closely related works.
We would like to clarify the nature of our contribution. SS-REPA is designed for compact convolutional encoder–decoders under onboard deployment constraints, where memory footprint and inference latency are first-order design requirements. Multi-level spatial convolutions are well suited to capturing local detail in physical fields and are deployment-friendly on edge devices, but they are weak at capturing global structure. Spectral neural operators, by contrast, encode global information through spectral features and therefore provide a useful spectral prior. SS-REPA is built on this complementarity in a deployment-driven way: it keeps the compact convolutional encoder–decoder as the deployed model and injects the spectral prior during training through branch-level selective alignment.
U-REPA (diffusion U-Net → ViT) differs from SS-REPA in four fundamental respects. (i) Application domain: U-REPA targets generative diffusion modeling, where the goal is to improve sample generation quality; SS-REPA targets onboard sparse physical-field reconstruction, where the goal is to recover dense physical states from sparse sensor measurements under tight memory and latency budgets. (ii) Model: U-REPA aligns a diffusion U-Net student to a ViT teacher; SS-REPA aligns a compact convolutional encoder–decoder. (iii) Motivation: U-REPA's alignment is intended to improve generative training dynamics; SS-REPA's alignment is intended to compensate for the limited global aggregation of a capacity-constrained convolutional bottleneck. (iv) Architectural design: U-REPA aligns a full hidden block and has no notion of branch-level selectivity; SS-REPA introduces a decoupled dual-branch bottleneck and aligns only its spectral branch, leaving the spatial branch free to preserve local detail.
REPA-P (teacher-free, physics-prior-driven) differs from SS-REPA in its supervision signal, its output, and its task. REPA-P is teacher-free and supervises training with PDE/boundary-condition residuals, and it decodes features into physical states; it is a generative model for scientific diffusion. SS-REPA is data-driven: it aligns to features of a pretrained spectral operator, with no physics residual and no physical-state decoding, and it is a discriminative reconstructor for sparse-field reconstruction. The two methods therefore rely on fundamentally different sources of prior knowledge—physics residuals versus a learned spectral representation—and address fundamentally different tasks—generative modeling versus discriminative reconstruction. The resemblance is at the level of using representation alignment as a training mechanism; the substance of what is aligned, why, and for what deployed purpose is different.
W2 and Q1: parameter-matched UNet (around 0.86M).
We thank the reviewer. We have added a near-parameter-matched reference, the Standard UNet (0.92M), as described in lines 359–360.
Q2: compare SS-REPA against conventional feature-level and output-level knowledge distillation?
We thank the reviewer for this suggestion. This comparison is reported in the ablation study (lines 411–413), with results in Table 3.
Q3: How sensitive is the performance to σ = 0.5?
We thank the reviewer for this suggestion. The sensitivity of SS-REPA to the bandwidth σ is reported in the revised Section 4 ("Effect of bandwidth σ", lines 507–510).
Q4: How robust is SS-REPA to sensor noise, missing sensors, and changes in sensor placement?
We thank the reviewer for this question, which we address along three axes. Sensor noise. A noise-robustness analysis is added in Section 4.3 (“Noisy Robustness”, lines 512-518).
Missing sensors and changes in sensor placement. These are evaluated on the Turbulent channel flow benchmark, whose protocol and sensor encoding are described in Appendix A.1.1.
Q5: Report mean ± standard deviation over multiple seeds.
We thank the reviewer for this request. We repeated the main accuracy comparisons over three random seeds (42, 123, 456); Appendix Tables 6–8 and 10 report means ± standard deviations. Tables 3 and 5 report three-seed means for the ablation settings.
Q6: Comparison with latent neural operators.
We thank the reviewer for this constructive suggestion. We have added comparisons against LNO, MMGN, SIREN, and WIRE to the main experiments (Table 1).
Among these, SIREN, WIRE, and LNO were originally proposed for other purposes: SIREN as a general implicit neural representation with periodic activations, WIRE as a wavelet-based implicit representation for image and signal reconstruction, and LNO for forward and inverse PDE problems in a latent space. We therefore adapt them to the sparse-field reconstruction setting rather than applying them out of the box, as described below and in Appendix A.1.3 (lines 910–951).