- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper is answering the question “When does accurate local posterior geometry yield accurate weighted function energies?” Prior work shows that under small-noise regimes, normalized covariance approaches the tangent projector matrix. Some works do this via training a neural network to learn this operator instead of approximating it in traditional ways (e.g. graph Laplacian, diffusion maps). Thus, each point can be assigned a matrix via this learned matrix field. This paper is saying – if we assume that this local matrix field is accurate and accessible at each point, does that mean we can accurately capture global quantities like energy of a function across the whole manifold? The authors conclude that this is not necessarily true,
Critical strengths
The paper is continuing the line of work where people are investigating normalized covariance approaching tangent projector, and what are its implications in terms of performing learning tasks along the manifold as a whole.
The circle example is clean and intuitive as a counterexample.
Critical weaknesses
The introduction reads as a dense list of facts. It does not tell the story of why this is an important or interesting problem. It does not highlight the main contributions of the paper. Also, there are a surprisingly small number of references mentioned in the introduction (only 4). The introduction needs a rewrite that would help the reader understand the bigger picture. Seems like the authors tried to make things compact to fit in 9 pages – I completely understand that this is challenging. But introduction is the most important section so I would suggest not cutting corners here. Also, lines 042-043 contain the word “from” twice.
A picture/drawing of the circle example could be great for illustration purposes.
Questions for authors
Could you please justify why this work is important? What does it add to the community? Why is this a next step to the described line of work? What are its main limitations? The appendix line 1701 mentions that limitations are described in section C.2, but that section is called "Training, numeric posterior, and error definitions” and does not mention limitations.
5 comments
Reply to Reviewer EZMx (2/3)
2. Main limitations
The experiments use controlled translation orbits with constant positive-definite intrinsic metrics, supplied densities, and fixed linear and cubic dictionaries. We have not established that these probes represent those in realistic applications. The strongest recovery uses oracle-assisted labels and a supplied intrinsic dimension.
The matched cohort contains two images, two covariance initializations, and one noise level. Additional matrix analyses do not enlarge that cohort. Additive-form and eigenspace outcomes remain mixed, and learned centers retain substantial errors. Numerical screens are descriptive sensitivity checks, not statistical tests or rigorous quadrature certificates. The results concern finite trial spaces; full-operator recovery would require additional approximation arguments.
Reply to Reviewer EZMx (3/3)
3. Presentation revisions
We will rewrite the introduction to follow the intended downstream quantity, the gap between local and form accuracy, the circle mechanism, and the three contributions above. We will expand the discussion of posterior geometry, ambient extensions, and variational spectral computation where it clarifies that progression.
We will add a geometric circle schematic showing identical intrinsic function values, different normal derivatives, and the resulting leaked energy, to complement the existing energy plot. We will also add an explicit limitations paragraph, repair the appendix limitations cross-reference, and check the reported duplicated “from” against the submitted text.
Reply to Reviewer EZMx (1/3)
Thank you for the feedback on motivation and presentation. We agree that the introduction should explain the intended use of learned geometry before listing the technical results. The additional analyses now provide a concrete example of both the benefit and the limits of transferring local geometry to outputs.
1. Why the problem matters and what the paper adds
A learned geometric matrix is an intermediate object when the intended output is a function energy or a spectral quantity. In a variational calculation, it enters through ∇f⊤C∇f. Matrix errors in directions with large ambient derivatives can therefore have a disproportionate effect. Researchers need to know which additional quantities to assess before using local geometry in such a calculation.
Our contribution has three connected parts:
The benefit to the community is a way to evaluate learned geometry through the functions and outputs it will actually serve. Local matrix accuracy, additive form accuracy, eigenvalue accuracy, and eigenspace accuracy answer different questions; the paper supplies conditions and controlled evidence connecting them. The new eigenvalue calculations concern actual finite-matrix outputs, with numerical sensitivity checked separately, and required no new training.