- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes a novel approach to the solution of Boltmann equation in the context of astrophysics and cosmology. This integro-differential equation governs the evolution of the density of particle species in the universe, and depends on the type of particles, on the geometry and on the physics ansatz considered. Solving this equation encompasses different issues that can be tackled using modern ML, in particular the the need to estimate an high dimensional integral, how to represent a valid class of solutions, and how to do it iteratively to find a solution of the differential equation. The proposed solution is based on a physics-informed NN that represents a class of solution, optimised via natural gradient optimisation, and on the use of Monte Carlo to estimate the high dimensional collision integral. The authors then present 3 experiments, going from toy examples to neutrino decoupling (computation of effective degrees of freedom of this particle).
Critical strengths
The overall aim of the paper is clear, and well motivated by physical applications. The use of ML appears to be decisive. In general, I really appreciate the tentative to use methods of ML to solve a real practical problem in computational physics.
Critical weaknesses
- The title: Neural boltzmann eq for what? Apparently mostly astrophysics, while BE is a wider concept and appears also elsewhere. Naming the paper Neural Boltzmann Equation could be misleading in my opinion.
- The venue: even if the paper present a very advanced application of machine learning to astrophysics and cosmology, in this form it appears to be too much "physics-centered" (I go against my physicist origins....) for ICLR. For example the object that is "neural" is a bit hidden in the text, I would prefer something like: "this is the object of study (BE) and classically we use this algo to solve the problem, and this leads to issues that are solved by our neural formulation".
- The review: I am not completely sure that a paper where the claim is "to perform the most numerically precise calculation to date of the effective number of relativistic neutrino degrees of freedom, Neff, in the Standard Model." should be sent to a conference, rather than a computational physics journal. In general, I believe that this paper deserves a more accurate and specialised review than the one that can provide someone (like me...) who was a physicist, but not computational astrophysicist.
- The comparison with SoTA: I would present in a more evident way the comparison (also in terms of computational cost) with SoTA methods used to tackle the same BE problems
- The algorithmic pipeline: before presenting the details of each step of the pipeline, I would appreciate a meta-algorithmic presentation of the overall procedure (this is the differential equation, this will be neural, this is estimated from data, this is sampled, etc). Also the choice of the symbols could be improved, to better distinguish what is analytic and what is trained, for instance and w should not be used in the same context (e.g. eq 11 etc). This would be fundamental for a general purpose venue as ICLR, especially in the application sub-sessions.
Questions for authors
- Why did you decide to submit this paper to a ML conference rather than a computational cosmology journal?
- Could you please elaborate more on the limitations and computational costs? This would be important for readers to elaborate possible follow-ups, and does not necessarily affect the goodness of the paper.
3 comments
Thank you for the responses. I am convinced to raise the score, but I still hope that, if accepted, the paper will appear also on some computational astrophysics venue.
Thank you for the fast response. We are happy to hear you appreciated these explanations.
We are working on a submission to an astrophysics and cosmology journal, where we showcase the benefits of NBEs on a wider range of early-universe processes including, for instance, dark matter production and leptogenesis.
Author rebuttal
Thank you for the thorough and constructive review. We are glad to hear that you appreciate our effort to solve a practical problem in computational physics, and that you found the overall aim of the paper clear and well motivated. Thanks as well for the questions and criticisms, which we address one by one below.
In this work, we specialise to Boltzmann equations in FLRW spacetime. However, besides the cosmology applications in the main paper, NBEs using our gamma mixture neural distribution function ansatz are readily extended to any isotropic, homogeneous kinetic theory problem. We demonstrate this in a new Appendix E, where we use NBEs to simulate a mixture of classical, non-relativistic gases.
Anisotropic or inhomogeneous systems require modified ansätze for the neural distribution function that include some combination of the momentum direction and spatial position of the particles. However, the high-level NBE workflow still applies: predict the parameters of the neural distribution function with a neural network, evaluate the collision operator, and then update the network parameters such that they solve the Boltzmann equation. We chose this title by analogy with neural quantum states and neural wave functions.
We tried to write the paper around the method, while giving the minimal physics background to make it self-contained. We extended the related work section to discuss the previous Boltzmann solvers and their limitations in more detail.
The paper does not claim to produce any new physics results. In the last sentence of the abstract, we claim the "numerically most precise" calculation, putting emphasis on the solver uncertainty. All expressions in Appendix B on the neutrino decoupling formalism have already been published in an equivalent form. We tried our best to include the minimal amount of physics context in our background and results sections, giving readers from the wider AI-for-science community enough information to understand the problem.
We extended the related work section to explain the properties of contemporary Boltzmann equation solvers in more detail. Our updated submission includes a 'rapid' neutrino decoupling config that achieves 1e-4 precision in 6min on a laptop, a 10x speedup compared to the 1h runtime for the same precision using the implementation of Bennett et al. on the same machine. We refer to our response to reviewer M7nf for more information.
We added Figure 1 to the updated submission, located at the start of the methods section, to give a high-level overview of the NBE workflow with references to the three method subsections.
We have replaced the label for the latent representation, ω→Θ, to avoid confusion with the gamma mixture weights or natural gradient step weights, w, and to use theta as a common label for learned objects.
This work is a collaboration between machine learning and cosmology researchers. Given the number of ways in which NBEs differ from previous Boltzmann solvers, and the list of benefits that NBEs have, we decided to have a separate methods paper that establishes the approach as a new computational paradigm for this class of problems. NBEs can also readily be applied to standard kinetic theory problems, as we demonstrate in Appendix E. We also believe that the way in which NBEs combine tools from different fields (optimisation, LHC physics, statistical physics) is a meaningful contribution to the wider ML community.
We extended the limitations and computational cost paragraphs with information about the initialisation cost, the benefits of running the code on a GPU, and challenges in conditional training.
We hope we were able to address your questions and look forward to discussing further.