- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a robust multi-view learning method based on a hybrid geometric reliability mechanism. The proposed method contains two modules, noisy correspondence augmented learning is introduced to generate the mismathced samples and supervise the training of the reliability estimator, hybrid geometric learning is introduced to maximize the geometric agreement across views. The experimental results on 12 MV datasets show that the proposed method is superior over the SOTA methods.
Critical strengths
- Different from previous methods that rely on pairwise statistics to determine view reliability, this method proposes a view reliability discrimination approach based on the overall geometry of views. It constructs the geometric structure of views jointly from Euclidean Gram geometry and Hyperbolic Gram geometry, fully exploiting the complementarity between Euclidean and hyperbolic geometries. This practice provides unique insights for the field.
- A contrastive loss based on Gram volume is proposed, which aims to minimize the volume of view-aligned samples while maximizing the volume of view-unaligned samples from a geometric perspective, thereby effectively separating aligned and unaligned samples. Furthermore, a view consistency loss is introduced to make the volume loss more directional.
Critical weaknesses
- The explanation of Figure 1 is insufficient. First, it does not clarify why the reliability densities output by BML overlap extensively, what such overlap implies, and what causes it. Second, it fails to specify what the box plots at the top of the figure represent and what important phenomenon they reveal. These missing details directly hinder the understanding of the HGR's advantages.
- The authors construct the Gram geometry of samples from both Euclidean and hyperbolic spaces, which raises the question of whether this is redundant. Since the downstream task is classification, which emphasizes the separability of different classes, it is unclear whether mining fine-grained hierarchical structure is meaningful. The authors should explain why hyperbolic geometry is further adopted.
- In Equation 21, the final Gram volume is obtained by fusing the Euclidean volume and the hyperbolic volume, with beta as a trainable weight parameter. The authors should provide the specific value that beta converges to when the algorithm reaches convergence, so that the necessity of the hyperbolic volume can be directly judged.
Questions for authors
- The authors introduce hyperbolic Gram geometry as a complement to Euclidean Gram geometry, but its necessity is not well justified. The authors should provide a proper argument for why hyperbolic space is needed.
- The value of beta at convergence should be reported, as it reflects how the Euclidean Gram volume and the hyperbolic Gram volume are balanced.
Response to Reviewer 1cHW
We thank the reviewer for the constructive comments. We have responded to these questions one by one.
The substantial overlap between the reliability distributions of clean and noisy views in BML primarily arises from its reliance on prediction-level statistics, including view-wise entropy and cross-view prediction consistency, which may fail to adequately capture structural distortions caused by view mismatches. Such overlap indicates that BML struggles to distinguish reliable from unreliable views, potentially assigning high reliability scores to corrupted views and misleading the final prediction. In contrast, HGR exploits Euclidean and Hyperbolic Gramian geometry to capture cross-view structural relationships, resulting in better separation between clean and noisy views. Furthermore, the box plots at the top of Figure 1 summarize the reliability score distributions, including their medians, interquartile ranges, and overall dispersion. Compared with BML, HGR exhibits a clearer separation between the two groups, demonstrating its stronger reliability discrimination capability.
We emphasize that hyperbolic geometry is introduced not to model hierarchical class structures, but to enhance view reliability assessment through complementary geometric information. Specifically, Euclidean Gramian geometry captures cross-view relationships through conventional inner products, while Hyperbolic Gramian geometry employs Lorentzian inner products to characterize structural relationships from a different geometric perspective. Their combination provides richer geometric representations for distinguishing reliable and unreliable views. Importantly, hybrid geometry is employed for view reliability assessment rather than direct classification, and thus does not require explicit class hierarchies. Furthermore, the following ablation results in Table 1 demonstrate that combining both geometries achieves better performance than using either alone, validating their complementarity.
Table 1. Ablation study with respect to Euclidean Gramian geometry(EGG) and Hyperbolic Gramian geometry(HGG).
In Eq. (21), the learnable parameter β adaptively balances the contributions of Euclidean and Hyperbolic Gramian volumes. To clarify their relative importance, we further examine the converged values of β across different datasets. The results in Table 2 show that β converges to [0.1, 0.8], indicating that both geometric volumes contribute to the optimization. These observations further support the effectiveness of hybrid geometric modeling.
Table 2. The converged valus of β on six multi-view datasets.