- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes the Homogeneous Autoencoder (HAE), a dimension-reduction architecture whose encoder has the form f(x) = r(x)·e(θ(x)). Here r is a chosen degree-one homogeneous radial functional and e is a learnt map between unit shells. As a result, the encoder is positively homogeneous and preserves the radius exactly. The decoder also preserves the radius exactly, and adds a radius-dependent angular correction that vanishes uniformly at large radii. This lets it represent non-conic bulk geometry while remaining asymptotically homogeneous.
Critical strengths
- Clear, well-motivated problem. Standard autoencoders give no guarantees on latent magnitude, and this is a real obstacle to doing extreme-value analysis in a learnt latent space. The paper states this cleanly, and Prop. 5 makes the non-identifiability point precise.
- Simple and principled construction. Factorising the encoder through the unit shell is elegant. The guarantees are architectural, so they hold independently of the loss and of optimisation. The vanishing decoder correction, built via the (1+r)⁻¹ reparameterisation with the boundary value subtracted, is a sensible way to reconcile curved bulk geometry with conic tail geometry.
- Prop. 11 is the most interesting result. It explains why exact radius preservation alone is insufficient. The AE + radius ablation isolates this effect empirically, and Table 5, with radii permuted to enforce independence, is a clean and convincing confirmation: HAE is the only neural model that never rejects independence.
- Careful, honest writing. The limitations section, the discussion of heterogeneous variables (App. I.4), and the explicit statement that the guarantees "need not reduce reconstruction error" are appreciated. Experimental details are thorough, and code is provided.
Critical weaknesses
-
Downstream benefit on real data is not demonstrated. The paper's main motivation is extreme-value analysis in latent space, but the generation advantage appears only on the synthetic surface. On ERA5 precipitation:
- In Table 4, AE + penalty attains lower generation error than HAE under both the fitted law and the empirical law.
- In Table 5, PCA outperforms all neural models, including HAE, under both laws.
The authors attribute this to the vMF fit. That may be correct, but it also means the real-data experiments do not show that HAE's better-preserved independence translates into better downstream analysis.
-
The synthetic benchmark is favourable to HAE by design. The surface is constructed so that, above the 0.85 quantile, direction is nearly independent of radius and the tail is close to conic, which are exactly HAE's assumptions. A setting in which these assumptions hold only approximately, or in which the tail support is genuinely curved, would be more informative.
-
Many reported metrics are tautological for HAE. Radial error, rank correlation and Hill difference are exactly 0 or 1 by construction. Moreover, AE + penalty already achieves rank correlation 1.000 and small Hill differences everywhere. On radial metrics alone, a soft penalty seems to suffice in practice, so the case for HAE rests mainly on independence preservation and equivariance. This should be stated more directly.
Questions for authors
- How does HAE compare with a "θ-autoencoder + raw radius" baseline, i.e. an AE trained on θ(x) whose output is rescaled by r(x)?
- On ERA5, is there any setting in which HAE's lower distance correlation leads to measurably better generation than AE + penalty?
Response to Review by Reviewer 4zpV
We thank the reviewer for a clear and constructive review. The reviewer reads the presentation of the model, experiments and limitations as we intended.
Regarding the downstream benefit on real data, the experimental results are intended to show that HAE provides guarantees on the latent space yet is able to match the practical performance of competitors, retaining its use for representation learning tasks whilst providing additional desirable structure, not to support a claim of uniform superior reconstructive or generative performance.
As well as clarifying the work's intended contribution, we hope that the general comment and revision further address the reviewer's main concern (and question 2) regarding performance on real data by providing a wind field example. In this experiment, HAE's preserved independence does indeed align with the lowest generation error for a factorised tail generator fit in latent spaces of the competing dimension-reducing models (Table 6). To provide further interpretation of Table 5, Appendix J identifies the fitted angular law as the key limitation on the neural models' generation and Section 7 recognises that a linear approach may be sufficient where the support is near a linear subspace.
The synthetic benchmark being compatible with HAE by construction is one reason why experiments are also conducted on real world data. As well as this, the synthetic benchmark satisfies the radial-angular independence assumption of the downstream generator only approximately. Its tail is correctly identified by the reviewer as close to, but not exactly, conic at finite scales. For generation, the precipitation exceedances provide the contrasting setting in which the factorised latent generative model's assumptions are not met and the generation advantage enabled by HAE is expectedly not observed. The wind exceedances experiment added to the revision provides a real data scenario in which independence holds approximately, as the reviewer suggests (Appendix K).
We agree that the radial metrics are exact for HAE by construction, as the daggers in Tables 1 and 3 indicate. These metrics are intended as diagnostics to show how HAEs architectural constraints contrast to the properties of competing models and not independent measures of learned performance. The experiments serve to illustrate that the competing methods fail to provide the same guarantees as HAE, whilst demonstrating that HAE can provide these properties while simultaneously achieving similar reconstructive performance and thus presents a minimal tradeoff.
If our interpretation of the reviewer's suggested θ-autoencoder + radius model is correct, its angular encoder and decoder act only on θ(x) with the decoded direction rescaled by r(x). Therefore the reconstruction map is positively homogeneous and it has a conic image. Under the same unit-shell latent parameterisation, it is architecturally equivalent to HAE with the decoder correction turned off and is thus less expressive than HAE. At the minimal latent dimension, this restricts the decoder's ability to represent manifolds with radius-dependent angular geometry (as on the curved surface example). Avoiding this restriction is what the HAE correction allows (Figures C.2 and C.3).
We thank the reviewer again for their careful reading and constructive comments. We hope these clarifications and additional real-data evidence address the reviewer's concerns.