- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes HPNO, a neural operator whose kernel lives on a weighted binary Haar tree. Each kernel action combines a bounded Haar multiplier with a mean-to-detail paraproduct and a detail-to-mean adjoint paraproduct. The coefficients of the two paraproducts are the Haar coefficients of two input-conditioned, tanh-bounded symbols. The authors show that the cross-cut transfer norms equal the regional standard deviation of the symbol. Using Carleson embedding, they also show that each fixed-input kernel action is bounded by a constant that does not depend on tree size or depth. Experiments cover six standard PDE benchmarks and two CFD datasets, plus ablations on Darcy and Elasticity and a paired Darcy test where permeability is rearranged without changing regional means.
Critical strengths
I like the core idea. Generating all coefficients in each direction from a single bounded symbol gives joint subtree control almost for free. It also makes the mean-to-detail and detail-to-mean responses easy to interpret, and the two-pass evaluation keeps the cost linear. Fig. 4b makes the point well: when the coefficients are predicted directly, they break the subtree bound. The results are also consistently strong across grids, meshes and point clouds. The ablation in Table 3, run inside the same pipeline, does support using both directions, untied symbols and bounded-symbol generation.
Critical weaknesses
My main concern is that I can't tell how much of the improvement comes from the kernel itself. Appendix E.2 says the baseline numbers are taken from earlier papers. HPNO, however, has extra task-specific machinery: a derivative loss on Darcy, local convolution, full-resolution refinement and a coarse-mean path. Table 3 makes this concrete. The multiplier-only model, which has no paraproducts at all, already gets 0.00345 on Darcy, better than every baseline in Table 1 (HNO is 0.0045). The paraproducts then take it from 0.00345 to 0.00311. So most of the gap to prior work seems to come from the rest of the predictor. The paired Darcy result has the same problem: a 34–40% lower response error could simply reflect HPNO's lower overall error.
My second concern is that the theory is largely classical and not clearly linked to accuracy. Theorem 1 is essentially the standard finite-tree Carleson embedding (Treil, 2013) applied to bounded symbols. It bounds one linear action at a fixed input. It says nothing about the stability or generalization of the full model, and the paper doesn't explain why this bound should lead to lower error. Also, on the CFD tasks the tree is built over slice slots, so the physical mean-versus-detail motivation doesn't really apply there.
Minor issues
Several citations failed to compile and show up as question marks: FNO, RNO and GEO-FNO in Tables 1 and 2, "(?Li et al., 2023b)" in Section 5 and Appendix E.2, and "benchmark interfaces of ?" in Appendix E.3.
In Table 1, WNO's Plasticity entry is just a dash with no explanation. In Definition 1, the difference between λ₀ (the root mean) and λ_S ("the root detail when present") is easy to misread and should be spelled out.
Naming is inconsistent: the dataset is "Shape-Net Car" in Table 2 but "ShapeNet Car" in the text, and the same variant is "Normalized-direct" in Fig. 4 but c̄ in Table 3.
Section 5.2 presents Normalized-direct staying under the bound as a finding, but Appendix F.2 shows the bound is enforced by construction, so it isn't evidence of anything. In Section 2, "Concurrently" is used for work from 2019 to 2023, which isn't concurrent. Finally, the main text doesn't report parameter counts, runtime or memory against the baselines.
Questions for authors
Could you put the HNO and LinearNO kernels inside your own predictor, with the same auxiliary paths, loss and training budget, and compare on Darcy, Elasticity and Plasticity? That would show what the kernel itself contributes, and it could change my score. In the paired Darcy test, how does the multiplier-only ablation do? What do the response errors look like after normalizing by each model's overall error? Do you have evidence that the bounded construction helps beyond the small gains in Table 3, for example with deeper trees, larger N or a change in resolution?
5 comments
Response to Reviewer sDXG (2/4): Paired Darcy Responses and Field-Error Normalization (W1 & Questions)
[W1 & Questions] Paired Darcy responses and field-error normalization
- "In the paired Darcy test, how does the multiplier-only ablation do?"
- "What do the response errors look like after normalizing by each model's overall error?"
1. Multiplier-only responses under the same paired-input protocol. We added multiplier-only HPNO to Figure 5 and report its results at every rearrangement level in Table F.1. Permeability is rearranged within fixed regions while preserving their weighted means; the domain, forcing, and boundary conditions remain unchanged. Frozen predictors estimate the solution change against , without response-specific training.
The response score is the weighted RMS error of regional mean changes. Full HPNO has the lowest aggregate response error at every tested rearrangement level (Figure 5(b), Table F.1). At , response RMS is 3.0556 for full HPNO, 3.5034 for -only HPNO, 4.6046 for HNO, and 5.0841 for LinearNO, in units of . Across the 50 matched pairs at this level, HPNO has lower error in 31 cases (62.0%) against -only, 39 (78.0%) against HNO, and 45 (90.0%) against LinearNO (Figure 5(c)).
2. Normalization by each model's overall field error. We report the requested normalization in Appendix F.3 and Table F.2: . Here, is the pooled field RMS over both members of the same input pairs, and is the pooled regional response RMS. Both use the same decoded physical fields and node weights. The results pool 50 base cases and ten rearrangement levels; both RMS columns below are in units of , and is dimensionless.
| Model | Field RMS | Regional response RMS | |
|---|---|---|---|
| HNO | 5.3977 | 3.4972 | 0.6479 |
| LinearNO | 6.1063 | 3.7096 | 0.6075 |
| HPNO (-only) | 4.8977 | 2.7585 | 0.5632 |
| HPNO | 3.8702 | 2.3503 | 0.6073 |
Full HPNO has the lowest pooled field and regional response errors. Its normalized ratio is lower than HNO's, close to LinearNO's, and higher than multiplier-only HPNO's. Adding the directional terms reduces field RMS from 4.8977 to 3.8702 and response RMS from 2.7585 to 2.3503; increases from 0.5632 to 0.6073 because field error decreases proportionally more.
We have revised the interpretation accordingly. The normalized results do not establish a uniformly smaller response-to-field error ratio. The paired experiment demonstrates improved absolute prediction of rearrangement-induced changes within the same predictor; the reciprocal replacements in Table 3 provide separate controlled evidence for the kernel's contribution beyond the surrounding pipeline.
Revisions in the manuscript: Section 5.2 and Figure 5 (multiplier-only and case-wise response comparisons); Appendix F.3 and Table F.1 (paired protocol and per-level results); Equations (F.15)-(F.16) and Table F.2 (field-error normalization and interpretation).
Response to Reviewer sDXG (3/4): Theory, Hierarchy Scaling, and CFD Support (W2 & Question)
[W2 & Question] Theoretical contribution and larger hierarchies
- "Theorem 1 is essentially the standard finite-tree Carleson embedding (Treil, 2013) applied to bounded symbols. It bounds one linear action at a fixed input. It says nothing about the stability or generalization of the full model, and the paper doesn't explain why this bound should lead to lower error."
- "Do you have evidence that the bounded construction helps beyond the small gains in Table 3, for example with deeper trees, larger N or a change in resolution?"
1. Theoretical contribution and scope. We credit the embedding estimate to classical Carleson theory. Our contribution is an input-conditioned coefficient construction: each bounded symbol generates all transfer coefficients in one direction, with explicit regional responses and joint control across nested regions. Proposition 1 and Equations (9)-(11) express both directional responses and their exact norms through regional symbol variation.
Theorem 1 bounds each fixed-input kernel action; it does not alone establish full-predictor stability or generalization. Appendix C.3 separates feature variation from input-induced kernel variation on a fixed weighted tree and bounds the latter through symbol and multiplier changes. Full-predictor stability additionally depends on the coefficient generators, representation maps, and nonlinear updates.
2. Connection to predictive accuracy. Direct bounds coefficients individually without enforcing joint subtree control. Normalized-direct enforces that control through a global rescaling factor for each direction, determined by the largest normalized subtree energy. HPNO instead generates Haar contrasts of pointwise-bounded symbols, satisfying the same subtree constraint without global rescaling (Appendix F.2).
In Table 4, Direct, Normalized-direct, and HPNO obtain Darcy errors of 0.00338, 0.00327, and 0.00311, and Elasticity errors of 0.00402, 0.00348, and 0.00314, respectively. These comparisons support bounded-symbol parameterization as an inductive bias beyond enforcing the bound alone. Figure 4(b) and Section 5.2 now explicitly state that HPNO and Normalized-direct satisfy the unit bound by construction.
3. Evidence beyond the default setting.
Resolution and hierarchy scaling (Figure 4(c)). Each variant is trained separately at each resolution. HPNO has lower error at every resolution, and the relative excess errors over HPNO increase across the four settings:
| Darcy resolution | HPNO error () | Direct excess | Norm-direct excess | |
|---|---|---|---|---|
| 7.86 | +1.4% | +2.7% | ||
| 3.11 | +8.7% | +5.1% | ||
| 2.10 | +13.1% | +9.7% | ||
| 1.91 | +20.8% | +18.6% |
Resolution, support size, and depth change together, so this is evidence across these combined settings rather than an isolated causal effect of depth. Table E.6 reports the corresponding inference latency and memory.
Support changes at fixed input resolution (Table E.5). With Darcy inputs fixed at , varying patch size changes Haar support while preserving the physical input resolution:
| Haar support | HPNO | Direct | Normalized-direct |
|---|---|---|---|
| 289 | 0.00335 | 0.00343 | 0.00346 |
| 841 | 0.00311 | 0.00338 | 0.00327 |
| 1,849 | 0.00322 | 0.00341 | 0.00335 |
HPNO has lower error than both direct variants at each support size, including the variant that already satisfies the subtree bound.
[W2] Interpretation of CFD supports
- "Also, on the CFD tasks the tree is built over slice slots, so the physical mean-versus-detail motivation doesn't really apply there."
For CFD, the hierarchy acts on learned slice features. Its means and details describe averages and contrasts among latent slots and need not correspond to physical neighborhoods or length scales. The weighted Haar identities and subtree bounds remain valid; slicing and deslicing connect these feature interactions to physical predictions. We now state this distinction explicitly. The paired Darcy experiment separately evaluates physical regional responses of the complete predictor.
Revisions in the manuscript: Sections 4.1, 4.2, and 4.4; Proposition 1 and Theorem 1; Appendices C.1-C.3 (theory and scope); Section 5.2, Figure 4(b,c), and Table 4 (diagnostics and ablations); Appendix E.4, Table E.5 (support accuracy), and Table E.6 (resolution-dependent costs); Appendices E.3 and F.2 (representations and variant definitions).
Response to Reviewer sDXG (1/4): Isolating Kernel Contribution and Multiplier-Only Model (W1)
Thank you for the detailed review and for recognizing the bounded-symbol construction, two-pass evaluation, and architectural ablations. We have revised the manuscript to directly test the kernel's contribution and clarify the theory and response diagnostics.
We organize our response into four posts:
All references refer to the revised manuscript. The new kernel-replacement experiments are in Table 3; the original architectural ablations are now Table 4. W1 and W2 below denote your two main concerns.
1. The requested comparisons under a shared predictor architecture. We performed these comparisons on all three requested tasks and extended them to Transolver++ and all eight benchmarks. Within each host predictor, we hold the feature interface, representation/reconstruction maps, residual and auxiliary paths, loss, data split, training budget, and final-epoch evaluation rule fixed. Every variant is retrained.
Table 3(a) gives the following relative ℓ2 errors within the HPNO predictor:
We also performed the reverse replacements. Table 3(b) reports native-kernel error → HPNO-kernel error within each baseline predictor:
The improvements in both directions show that the surrounding task-specific pipeline alone does not explain the gains. Table 3 also reports the remaining tasks, including CFD metrics where the effect depends on the host representation and output quantity.
2. What the multiplier-only result establishes. The multiplier-only ablation retains a learned, input-conditioned Haar kernel: M reweights the root mean and every Haar detail. Removing the two paraproducts therefore does not remove the kernel or its multiscale representation. The difference between multiplier-only HPNO and literature-reported HNO cannot, by itself, be assigned to the surrounding predictor.
The new controls separate these effects. With the HPNO predictor architecture held fixed, alternative kernels obtain Darcy errors of 0.0040 to 0.0043 (Table 3(a)), the Haar multiplier alone obtains 0.00345, and adding both directional transfers gives 0.00311 (Table 4). On Elasticity, alternative kernels obtain 0.0036 to 0.0045, while adding both transfers to M lowers error from 0.00364 to 0.00314. Table 3 tests the kernel choice within each host architecture, while Table 4 tests directional coupling within the Haar kernel.
Revisions in the manuscript: Section 5.1 and Table 3 (reciprocal kernel replacements); Appendix E.2, "Controlled kernel comparisons" (interfaces and training controls); Section 5.2, Table 4, and Appendix F.2 (multiplier-only interpretation and ablations).