- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This submission proposes MGME for open-world object detection, which replaces a single unknown-class representation with multiple synthetic unknown prototypes. The method estimates a principal subspace from known visual features, samples directions from a truncated residual subspace, and projects these directions onto the tangent space of each known-class center. Candidate prototypes are generated through spherical geodesic traversal, filtered by their similarity to other known classes, and then ranked using a domain-level text embedding derived from LLM-generated concepts. The method also add a decorrelation loss on known-class text prototypes during adaptation. Experiment on five RWD datasets report improvements in average unknown and known detection performance over the evaluated baselines.
Critical strengths
- The motivation for using multiple unknown prototypes is reasonable.
I also agree that a single representation is a restrictive model for heterogeneous unknown objects. Generating several prototypes around known categories provides a practical alternative, without requiring annotated unknown instances.
- The reported aggregate gains are substantial.
On ViT-B/16, average U-mAP increases from 6.8 for PASS to 11.8. And on ViT-L/14, it increases from 15.9 for UMB to 19.2. Average known-class performance also improves. Evaluation across five domains and two backbone sizes provide useful evidence that the gains are not restricted to one setting.
- The comparison is reasonable.
The submission report using common splits, support samples, attribute pools, and evaluation code for the reproduced methods. Sharing the generated vocabulary with BASE-ZS+LLM is also helpful, although this comparison does not fully isolate the geometric component. Component ablations and failure cases also provide additional insight into the method.
Critical weaknesses
- The geodesic ablation does not adequately establish the claimed geometric advantage.
For unit vectors and with ,
\frac{c+\alpha v}{\||c+\alpha v\||} =\cos\theta c+\sin\theta v, \qquad \alpha=\tan\theta, \$$ for the angles used in this submission. Thus, normalized additive perturbation with a matched step size produces exactly the same candidate as Eq. 3. Sec. 4.3 appropriately limit its conclusion to the particular implemented Euclidean variant, but that variant is not specified. The large performance gap in Tab. 2 therefore cannot be interpreted without knowing whether normalization, directions, and angular displacement were matched. This does not invalidate the overall method, but it weakens the broader contrast between Euclidean and manifold-based construction. 2. **The connection between generated prototypes and the detection head is missing.** Sec. 3.2– Sec. 3.4 produce vectors in $\mathbb{R}^d$, whereas Eq. 7 requires additional columns in the attribute assignment matrix $W$. The submission does not explain how each generated vector is converted into an $M$-dimensional weight column. If this involves reconstruction through the attribute embeddings, the effective classifier may differ from the generated prototype, which may potentially change the geometric constraints established during selection. I think this is a necessary detail for understanding and reproducing the method. 3. **Several geometric guarantees are stronger than the construction supports.** Unit norm does not establish that a prototype has visual objectness, or lies in a populated region of the visual feature distribution. Similarly, the threshold in Eq. 4 constrains similarity to non-parent class centers, not the actual decision boundaries or full class distributions. Moreover, projecting a residual vector onto a class-specific tangent space do not generally preserve orthogonality to the principal subspace: $$\ q^\top\left[v_{\mathrm{res}}-(v_{\mathrm{res}}^\top c_k)c_k\right] =-(v_{\mathrm{res}}^\top c_k)(q^\top c_k) \$$ for a principal direction $q$. Claims of collision-free exploration and preserved foundational attributes should therefore be qualified or supported by direct measurements. 4. **The experiments do not sufficiently separate the benefit of multiple prototypes from the proposed generation mechanism.** I think it's better to include known-class centers used as unknown prototypes, random tangent-space prototypes, and direct LLM text prototypes, all evaluated with the same adapted model and comparable prototype counts. BASE-ZS+LLM differs in adaptation as well as prototype construction, thus its gap to MGME does not isolate geometric alignment. Also, the one-prototype-per-class setting in Tab. 4 is not a global single-prototype baseline.Questions for authors
-
What is the formula for the Euclidean-addition ablation? Are the perturbation directions, normalization, angular distances, sampling budgets, and selection procedures matched to MGME?
-
How are generated unknown prototypes converted into the additional columns of in Eq. 7?
-
How much principal-subspace alignment is reintroduced by Eq. 2 in practice? It's better to also report candidate rejection rates and prototype similarities to known instances to support the claims about boundary safety.
-
Can the authors compare alternative prototype constructions under a fixed adapted checkpoint and matched prototype counts? In particular, direct LLM text prototypes and random tangent-space prototypes would help to establish what the proposed residual-space construction add.
5 comments
Response to Reviewer jdXm (Part 2/4)
Q2 (W2): How are the generated unknown prototypes incorporated into the attribute-based detection head in Eq. (7)?
A1. Direct integration into the detection head. We thank the reviewer for highlighting this missing implementation detail. We agree that the original description did not sufficiently explain how the generated -dimensional unknown prototypes are integrated into the attribute-based classifier.
Importantly, the generated prototypes are directly appended to the embedding matrix rather than reconstructed through the original attribute embeddings. Therefore, their geometric representations are preserved when incorporated into the detection head.
Specifically, the original attribute-based classifier contains an attribute embedding matrix and an attribute-to-class assignment matrix , where is the number of attributes and is the number of known classes.
Let denote the generated unknown-prototype matrix, with each row corresponding to one prototype . We extend the two matrices as
E_{\mathrm{att}}^+ &=[E_{\mathrm{att}};P_{\mathrm{unk}}] \in\mathbb R^{(M+U)\times d},\\\\ W^+ &=\operatorname{blockdiag}(W,I_U) \in\mathbb R^{(M+U)\times(K+U)}. \end{aligned}$$ Here, $I_U$ is an identity matrix that establishes a direct one-to-one mapping between the generated unknown prototypes and the additional unknown-response channels. **A2. Preservation of the generated prototype representations.** For a visual embedding $v$, the expanded raw-logit computation in Eq. (7) becomes $$\begin{aligned} Logit_{\mathrm{raw}} &=\cos(v,E_{\mathrm{att}}^+)\\,W^+\\\\ &=[Logit_K,Logit_{U_1},\ldots,Logit_{U_U}]. \end{aligned}$$ Because the additional block in $W^+$ is $I_U$, each generated unknown prototype directly contributes its own cosine-similarity response. No additional attribute reconstruction or learned projection is applied to the generated prototypes at this stage. Consequently, the effective unknown classifier directions remain those obtained through the geometric construction and selection process, addressing the reviewer's concern that reconstructing the prototypes through the original attributes might alter their geometric properties. The individual unknown responses are then aggregated into a single unknown score: $$Logit_U^*=\max_{i=1,\ldots,U}Logit_{U_i}.$$ Following the inherited inference framework, this response is combined with the existing attribute-relevance and outlier-suppression factors: $$P_U(v)=\sigma(Logit_U^*)\\,p_{\mathrm{ID}}(v)\\,p_{\mathrm{OOD}}(v).$$ Thus, MGME expands the internal unknown representation while retaining a unified unknown prediction and the baseline scoring framework. **Manuscript revisions.** We have added the explicit definitions and dimensions of $E_{\mathrm{att}}^+$ and $W^+$ in **Sec. 3.5 (Multi-Prototype Inference)** and revised **Eq. (7)** to show how the generated prototypes are directly incorporated into the detection head. We appreciate the reviewer's suggestion, which has helped us clarify an important implementation detail and improve the reproducibility of our method.Response to Reviewer jdXm (Part 3/4)
Q3 (W3): Geometric Constraints and Boundary Safety
We thank the reviewer for the insightful suggestions regarding the geometric properties of our construction, particularly visual objectness, residual-subspace orthogonality, and boundary safety. We agree that these properties should be distinguished from strict mathematical guarantees. To better substantiate our claims, we have conducted additional geometric analyses covering principal-subspace alignment, candidate rejection rates, and prototype similarities to known instances.
A1. Residual-subspace and tangent-space orthogonality. We agree that the tangent-space projection in Eq. (2) does not necessarily preserve strict orthogonality to the global principal subspace.
Let denote the principal-subspace basis and the focused residual-subspace basis. Since both are extracted from the same eigendecomposition, . Thus, the initial direction is strictly orthogonal to the principal subspace.
However, projecting this direction onto the local tangent space of the known-class center gives
\left(v_{\mathrm{res}}-\langle v_{\mathrm{res}},c_k\rangle c_k\right).$$ As correctly noted by the reviewer, this operation may reintroduce principal-subspace components: $$Q_P^\top\left(v_{\mathrm{res}}-\langle v_{\mathrm{res}},c_k\rangle c_k\right) =-\langle v_{\mathrm{res}},c_k\rangle Q_P^\top c_k.$$ **Nevertheless, our additional geometric analysis shows that the practical magnitude of this deviation is small.** Across all five RWD datasets and both ViT-B/16 and ViT-L/14 backbones, the mean principal-subspace energy ratios, measured as $E_{\mathcal P}=\\|Q_P^\top v^\perp\\|_2^2$, range from $4.162\times10^{-4}$ to $7.345\times10^{-4}$. These results indicate that although tangent-space projection can reintroduce principal-space components, the resulting directions retain low principal-subspace alignment on average. We have corrected the strict inclusion in Sec. 3.1 (Eq. 1), clarified the projection in Sec. 3.2, and added the complete quantitative results to the Appendix under *Principal-Subspace Energy After Tangent Projection*. **A2. Boundary-pruning effectiveness.** We agree that the similarity threshold in Eq. (4) constrains candidate alignment with non-parent known-class centers, rather than guaranteeing separation from complete known-class distributions or decision boundaries. To further examine the practical effect of this constraint, we measured candidate rejection rates and prototype-to-known-instance similarities before and after pruning, prior to semantic selection. Specifically, for each candidate prototype, we compute its maximum cosine similarity to known instances excluding its parent class, and then average these maxima over the candidate set. The ViT-L/14 results for domains with nonzero rejection rates are summarized below: | Dataset | Rejection Rate | Before | After | |---|---:|---:|---:| | Aerial | 4.52% | 0.82 | 0.81 | | Medical | 31.19% | 0.84 | 0.83 | | Surgery | 40.00% | 0.82 | 0.81 | The pruning mechanism rejects candidates with excessive similarity to other known-class centers, with rejection rates varying across the evaluated domains. These differences may reflect variations in inter-class feature proximity. Importantly, the average maximum similarity to non-parent known instances also decreases after pruning, providing additional evidence that the center-based constraint helps reduce potential interference with known instances. These observations are further supported by the existing ablation in Table 2: removing Boundary Pruning decreases Aerial U-mAP from **12.6 to 10.7** and Medical K-mAP from **28.3 to 25.3**, demonstrating its contribution to unknown discovery and known-class preservation. We have also clarified that unit normalization guarantees a representation on the hypersphere, but does not by itself establish visual objectness. Accordingly, we characterize the proposed constraints as mechanisms for reducing potential cross-class interference and guiding prototype construction, rather than guaranteeing collision-free exploration. **Manuscript revisions.** We have clarified the residual-subspace and tangent-space constraints in Secs. 3.1–3.2 and included the complete principal-subspace energy analysis in the Appendix. We have also added the boundary-pruning diagnostics to the Appendix and refined the corresponding statements concerning visual objectness and boundary safety in Secs. 3.2–3.4. We appreciate the reviewer's suggestions, which have helped us strengthen the quantitative evidence and provide a more precise characterization of MGME's geometric constraints.
Response to Reviewer jdXm (Part 1/4)
We sincerely thank the reviewer for the careful and constructive assessment of our work, particularly for recognizing the motivation of multi-prototype unknown modeling, the substantial empirical improvements, and the fairness of our experimental comparisons. We appreciate your detailed comments on the geometric formulation and implementation, which have helped us clarify several important aspects of MGME.
Q1 (W1): Clarification of the Euclidean-addition ablation, including its construction formula, normalization, angular displacement, and comparison settings.
A1. Mathematical equivalence. We agree that, for a unit known-class center ck and a unit tangent direction v⊥ satisfying ck⊤v⊥=0, the spherical exponential map in Eq. (3) is mathematically equivalent to normalized Euclidean addition with a matched angular displacement:
=\cos\theta\\,c_k+\sin\theta\\,v^\perp =\operatorname{Normalize}(c_k+\tan\theta\\,v^\perp).$$ Therefore, when the exploration direction and angular displacement are matched, these two formulations produce identical prototypes and cannot exhibit an intrinsic performance difference. **This ablation was intended to evaluate an alternative prototype-construction strategy against MGME's residual-guided geometric construction, rather than to compare two mathematically equivalent formulations. We apologize that this intended comparison was not sufficiently clarified in the original manuscript.** **A2. Implementation of the Euclidean-addition variant.** We apologize for the ambiguity introduced by the term "Euclidean Add." in Table 2. Specifically, this variant refers to an alternative prototype construction based on **Euclidean addition along the difference between neighboring known-class centers**, rather than replacing Eq. (3) with its equivalent normalized additive form. For each known-class center $c_k$, we identify its nearest other known-class center $c_{j^*}$ according to cosine similarity. We then compute $$\begin{aligned} d_k &= c_{j^*}-c_k,\\\\ p_k^{\mathrm{Euc}} &=\operatorname{Normalize}\left( c_k+0.5[d_k+0.1\\|d_k\\|_2\xi] \right), \end{aligned}$$ where $\xi$ is a randomly sampled unit vector. The resulting prototype is **L2-normalized**. The coefficient 0.5 controls interpolation along the inter-class difference and is not chosen to match the angular displacement $\theta$ in Eq. (3). Thus, the variant differs from MGME in both its exploration directions and angular displacements. Therefore, Table 2 compares different prototype-construction strategies rather than two equivalent parameterizations of the same traversal. **A3. Interpretation of the results.** The purpose of this variant is to evaluate whether simple inter-class Euclidean addition can provide an effective alternative to MGME's residual-guided, angularly controlled prototype construction. As reported in Table 2, the variant achieves U/K-mAP of **5.6/39.9 on Aerial** and **1.8/28.2 on Medical**, compared with **12.6/42.0** and **15.1/28.3** for MGME. These results support the effectiveness of the complete MGME prototype-construction strategy relative to this particular alternative, rather than demonstrating an intrinsic superiority of the exponential map over mathematically equivalent normalized addition. **Manuscript revisions.** We have explicitly clarified the equivalence between geodesic traversal and normalized Euclidean addition in **Sec. 3.3**, renamed the ablation **"w/o Geodesic Escape (Inter-class Euclidean Add.)"** in **Table 2**, and added its implementation formula and corresponding interpretation in **Sec. 4.3**. We appreciate the reviewer's observation, which has helped us distinguish the geometric parameterization from the actual unknown-prototype construction strategy and present a more precise interpretation of our results.