- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes HiLS, an INR-based framework for sparse-to-dense continuous physical-field reconstruction. HiLS combines Sparse Context Encoding (SCE), which jointly encodes sparse observation values and locations into compact latent representations, with Hierarchical Latent Modeling (HLM), which retains and fuses representations from multiple Rational Function blocks. The method is evaluated across multiple scientific datasets, sampling configurations, sparsity levels, and temporal extrapolation settings.
Critical strengths
strengths:
-
Comprehensive baseline evaluation. The paper compares against a broad range of INR baselines, although the baselines can be dated and omits several most relevant methods.
-
Comprehensive dataset x sampling-ratio evaluation. The experiments span four datasets, four sensor/sampling tasks, and multiple sparsity levels, providing broad coverage of different sparse-observation settings.
Critical weaknesses
weaknesses:
- Critical prior work is missing, which fundamentally undermines the paper's novelty claims and baseline evaluation.
The paper explicitly claims that, “unlike other INRs, the content information is encoded together with the coordinates,” and later identifies “Context Input, Spatial Context Encoding, Hierarchical Modeling, and use of Rational function layers” as architectural distinctions absent from its selected INR baselines.
These claims omit highly relevant conditioned neural field / INR. Most notably, SCENT [1] already models continuous scientific fields conditioned on observations and uses learned queries/cross-attention for reconstruction at arbitrary locations from sparse observations. OmniField [2] further demonstrates observation-conditioned continuous fields under sparse and irregular multimodal inputs. Thus, the general premise that incorporating observation content into continuous neural fields is a distinguishing feature of HiLS is not supported.
This omission of these work is nontrivial to the soundness of the manuscript. The novelty claims need to be fundamentally rewritten relative to these works, and SCENT in particular represents a highly relevant missing baseline that should be experimentally compared. The reported breadth of 64 settings cannot compensate for omission of the closest comparison class under fair settings such as iso-param and iso-compute.
- After stripping away established components, the paper does not clearly identify and isolate what architectural design is actually new.
SCE combines observation conditioning [1], prior Gabor coordinate encoding, and Perceiver/Q-Former-style learned-query cross-attention/pooling [5,6]. In Eqs. 163–167, (W_A) can be equivalently interpreted as a bank of learned query embeddings attending to the coordinate features (G(K)). HLM similarly builds on mid-layer feature reuse, a well-established principle in architectures such as U-Net, DenseNet [3] and FPN [4]. Rational/KAT [7,8] components are also adopted from prior work.
The current leave-one-component-out ablations remove large bundles (-SCE, -Hierarchical, -Rational) rather than isolating the non-standard part of each design. The ablation study should instead first clearly identify the actual architectural choice or recipes that are new to current state of research, then compare that choice against its closest best-performing alternative.
More fundamentally, demonstrating that a large combination of established techniques works well is, in my opinion, not sufficient to establish a useful contribution to the community. Without isolating which design choice is responsible for the gain, the resulting method remains difficult to understand and unnecessarily difficult to extend. Researchers cannot know which parts are essential and which can be safely replaced or omitted.
- The -Hierarchical ablation is not sufficiently defined to establish what HLM contributes.
The paper does not clearly specify the architectural difference between HLM and its “sequential” counterpart, nor is the sequential implementation provided. This makes it impossible to determine what is actually held fixed in the comparison, considering HLM itself is a heavily-involved with many coupled design: retaining intermediate Z^{(r)}, constructing level-specific reconstruction representations V^{(r)}, and fusing them across levels.
Replacing HLM with an unspecified “sequential” model removes several coupled components at once rather than constituting a clean ablation of an isolatable design choice. As a result, the reported -Hierarchical degradation cannot be attributed specifically to intermediate-feature reuse, level-specific reconstruction, cross-level fusion, or their interaction.
Figures 5–6 inherit the same ambiguity. They visualize scalar “block-wise representations” and intermediate reconstructions, although the intermediate latent/block features are high-dimensional, without clearly explaining how these quantities are decoded for either architecture. Consequently, neither the ablation nor these figures cleanly establish that HLM preserves complementary or multiscale spatial structures.
- Unclear Rational Function formulation and effect.
The Rational Function component appears to follow the KAT-style formulation of Yang and Wang [7], and the released code directly includes the rational_kat_cu implementation [8]. Appendix A.1 discusses the underlying rational function (\phi(x)), but does not provide the full definition of the Rational Function block (R_r) actually used in HLM. The main method section also does not properly reference the KAT formulation. Proper citations should be provided for the implemented Rational Function, and the complete definition of (R_r) should be included in the appendix.
The claimed benefit of Rational Functions is also difficult to establish from Figure 7. The figure provides only qualitative signed-error maps without corresponding per-example errors, and the visual differences are not consistently in favor of the rational variant. In particular, in the first, second, and last rows, the MLP residuals appear comparable to or in some regions milder than those of the rational model.
[1] Park et al., SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields, ICML 2025.
[2] Valencia et al., OmniField: Conditioned Neural Fields for Robust Multimodal Spatiotemporal Learning, ICLR 2026.
[3] Huang et al., Densely Connected Convolutional Networks, CVPR 2017.
[4] Lin et al., Feature Pyramid Networks for Object Detection, CVPR 2017.
[5] Jaegle et al., Perceiver: General Perception with Iterative Attention, ICML 2021.
[6] Li et al., BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models, ICML 2023.
[7] Yang and Wang, Kolmogorov-Arnold Transformer, ICLR 2025.
[8] Yang, rational_kat_cu: CUDA/Triton Rational Function for Kolmogorov-Arnold Transformer (KAT), GitHub repository.
Questions for authors
See weakness for the need to rewrite overclaimed novelty, present a cleanly isolated and validated technical contribution beyond a bundle of known techniques, and improve literature attribution and technical method clarity.