- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes a bounded-shrinkage weighting method for stochastic Bellman regression in the DFLM framework for neural PDE solvers, accounting for location-dependent target spread and uncertainty in its estimation. It combines a gate that adjusts weighting strength based on this uncertainty, clipping that limits extreme weights, and a uniform floor that maintains a minimum contribution from each point by mixing with uniform weights, aiming to suppress target noise while preserving the learning signal in regions where the solution varies rapidly.
Critical strengths
S1. Section 3 analyzes the relationship between return variability and the spatial gradient of the current approximate solution, explaining how noise-suppressing weights can also weaken the learning signal needed in regions where the solution changes rapidly. By distinguishing noise magnitude, bias arising from weight–target dependence, and changes in the regression solution induced by reweighting, it clarifies why noise reduction does not necessarily improve solution accuracy and motivates the design of the proposed method.
Critical weaknesses
W1. [Writing and Organization] The presentation would benefit from a clearer explanation of how the regression objective in Eq. (4) follows from the stochastic formulation used in prior DFLM work [1, 2]. Although Eqs. (6) and (7) are briefly explained, their connection to Eq. (4) and their role in motivating bounded-shrinkage weighting should be developed more systematically. Furthermore, terms such as PPO clipping and group normalization (line 95) are introduced without sufficient explanation of their roles in the estimator comparisons. The authors should also clarify which aspects of the theoretical analysis build on [2] and what additional insights or guarantees the current results provide for the proposed weighting scheme.
W2. [Theory] The analysis in Section 3 quantifies noise and local fitting tradeoffs and motivates the design of bounded-shrinkage weighting. However, it remains unclear how these results translate into improved PDE approximation accuracy relative to uniformly weighted regression. The authors should clarify the extent to which the current theoretical results support such an improvement and under what conditions.
W3. [Experiments] The performance comparisons and component ablations for the proposed bounded-shrinkage method remain incomplete, leaving the central contribution insufficiently validated. The completed results are limited to comparisons between inverse-spread weighting and uniformly weighted regression, and are therefore insufficient to establish improvements in accuracy, stability, or computational efficiency for the proposed method.
[1] Han, J., Nica, M., & Stinchcombe, A. R. (2020). A derivative-free method for solving elliptic partial differential equations with deep neural networks. Journal of Computational Physics, 419, 109672. https://doi.org/10.1016/j.jcp.2020.109672
[2] Han, J., & Lee, Y. (2025). An analysis of the derivative-free loss method for solving PDEs. arXiv preprint arXiv:2309.16829v2.
Questions for authors
[Q] I understand that the Bellman targets are constructed using the Feynman–Kac formulation underlying [1, 2]. Could the authors clarify the relationship between the underlying SDE and the proposed weighting scheme? Beyond using the empirical spread of the sampled returns, does the specific bounded-shrinkage rule admit a theoretical justification or interpretation in terms of properties of the underlying stochastic process?
[1] Han, J., Nica, M., & Stinchcombe, A. R. (2020). A derivative-free method for solving elliptic partial differential equations with deep neural networks. Journal of Computational Physics, 419, 109672. https://doi.org/10.1016/j.jcp.2020.109672
[2] Han, J., & Lee, Y. (2025). An analysis of the derivative-free loss method for solving PDEs. arXiv preprint arXiv:2309.16829v2.