- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 2(+1)
Read review
Paper summary
This paper addresses multi‑view visual heterogeneity and modality gap in multimodal 3D object representation learning. The proposed AVA‑3D framework consists of two core modules: Mixture of Arbitration (MoA) which transforms view‑level multi‑view features into a set of latent complementary visual attributes via dual‑axis competitive arbitration, and Conditional Attribute Fusion (CAF), which adaptively routes and applies attribute‑specific residual updates conditioned on point‑cloud geometry to enhance 3D representations. The model is trained with multimodal contrastive losses. Evaluations are conducted on Objaverse‑LVIS, ModelNet40 and ScanObjectNN under different pre‑training data scales, including ablation studies, slot / view hyper‑parameter analysis, attribute correlation and intervention analysis, plus cross‑modal retrieval experiments.
Critical strengths
-
Well‑defined problem statement for multi‑view heterogeneous fusion. The paper clearly identifies the limitation of existing global / view‑level multi‑view aggregation, and proposes to shift to attribute‑level representation learning. The motivation is reasonable for multimodal 3D pre‑training research.
-
Diverse set of empirical analyses beyond main benchmark numbers. Besides zero‑shot classification, the paper provides slot‑attribute correlation analysis and controlled attribute intervention experiments to interpret what MoA slots learn, which brings additional insight for understanding the module behavior.
Critical weaknesses
-
Crucial overview Figure 2 has severe rendering defects that harm paper readability and reproducibility assessment. In the provided manuscript PDF, Figure 2 (the full pipeline overview) suffers from missing text labels and indistinguishable grey‑purple graphic elements. This is the central diagram explaining MoA‑CAF workflow. Without legible figure, reviewers cannot reliably verify whether the architectural description matches the diagram, which is a major presentation flaw for conference submission.
-
Limited practical grounding of latent visual attributes. MoA produces purely latent slots without explicit semantic supervision. Although correlation and intervention tests are provided, there is no clear mechanism to guarantee slots consistently correspond to meaningful visual attributes across different datasets / object distributions. The claimed “attribute‑level” abstraction remains largely post‑hoc interpreted rather than guaranteed by model design. In addition, overall experimental workload is moderate, and gains on several real‑world benchmarks are only marginal compared to strong existing baselines.
Questions for authors
-
Please provide a properly‑rendered, complete version of Figure 2 with all text labels visible and clear visual distinction between grey and purple graphical components. Clarify each intermediate tensor flow shown in this pipeline diagram.
-
Are the learned MoA slot‑to‑visual‑attribute associations transferable when evaluated on completely unseen object categories? Can you provide quantitative metrics measuring slot consistency across different object sets, instead of only correlation / intervention examples on Objaverse?
-
In Table 1, under the full Ensembled pre‑training setting, AVA‑3D only brings small gains over strong baselines on ModelNet40. Please analyze why the improvement is much weaker on this dataset compared to Objaverse‑LVIS.
4 comments
Reply to Reviewer DTTQ (Part2)
Q2 (Transferability of Slot–Attribute Associations)
“Are the learned MoA slot-to-visual-attribute associations transferable when evaluated on completely unseen object categories? Can you provide quantitative metrics measuring slot consistency across different object sets?”
Thank you for suggesting this evaluation. Using the model pretrained on Ensembled (No LVIS), we evaluate slot–attribute consistency between seen categories and completely unseen Objaverse-LVIS categories. For each slot, we construct an attribute profile by averaging the z-scored visual-attribute values of its selected views within each object set, then measure the similarity of these profiles across sets. This establishes cross-set consistency on held-out objects; a claim of completely unseen-category transfer additionally requires a category-disjoint split.
As shown in Table G, the same-slot cosine similarity reaches 0.96, substantially higher than the 0.20 similarity between different slots. Furthermore, the 0.78 Top-5 attribute overlap indicates that the dominant attribute preferences are largely preserved across the evaluated object sets. These results provide quantitative evidence of consistent yet differentiated attribute preferences on held-out objects.
| Metric | Result | Comparison |
|---|---|---|
| Same-slot cosine similarity | 0.96 | Same-slot attribute profiles across sets |
| Cross-slot cosine similarity | 0.20 | Different-slot attribute profiles across sets |
| Top-5 attribute overlap | 0.78 | Fraction of shared top-five attributes for the same slot across sets |
Table G. Cross-set consistency of selected-view attribute profiles.
Q3 (Gains on ModelNet40)
“Please analyze why the improvement is much weaker on this dataset compared to Objaverse-LVIS.”
Thank you for raising this question. ModelNet40 views rendered from largely textureless CAD-derived point clouds provide limited appearance information beyond geometry, reducing the complementary evidence available to MoA and CAF. Recognition therefore relies more heavily on the point-cloud branch. In contrast, Objaverse-LVIS offers richer, more heterogeneous views and a substantially more challenging long-tailed evaluation set (46,832 objects across 1,156 categories, versus 2,468 test objects across 40 categories in ModelNet40).
Consistent with this difference, under Ensembled (Full) pretraining, AVA-3D improves over MixCon3D by 0.9 points on ModelNet40 (87.7% vs. 86.8%), but by 3.3 points on Objaverse-LVIS (55.8% vs. 52.5%), where complementary visual evidence is more informative.
Thank you for the reviewers’ careful feedback. Most of my concerns have been addressed, and I am willing to raise my score to 3.
Good luck!
Thank You for Your Feedback
We are glad that our response has addressed your concerns. We sincerely appreciate your thoughtful review and positive feedback.
Reply to Reviewer DTTQ (Part1)
Thank you for your thoughtful and constructive review. We appreciate your recognition of our motivation for attribute-level multi-view fusion and the insights provided by our correlation and intervention analyses. In response, we have revised Figure 2 to improve its visual clarity and readability and clarified the interpretation and limitations of implicitly learned attributes. We have also added a quantitative evaluation of slot–attribute consistency across seen and held-out object sets and analyzed the smaller improvements on ModelNet40 relative to Objaverse-LVIS. We address each concern in detail below.
W1, Q1 (Figure 2 Readability)
Thank you for bringing this to our attention. We carefully inspected the original PDF but could not reproduce the reported rendering issue. Nevertheless, we have revised Figure 2 by enlarging the text labels, strengthening the color contrast, and clarifying the intermediate tensor flows to improve overall readability. The updated figure is included in the revised manuscript.
W2 (Practical Grounding of Latent Visual Attributes)
Thank you for raising this concern. We clarify that our attributes are data-driven latent representations, not explicitly defined semantic concepts. MoA organizes complementary evidence from heterogeneous views, and CAF integrates it with point-cloud geometry under multimodal contrastive supervision. Thus, “attribute-level” describes the granularity of evidence organization and fusion; it does not imply a guaranteed one-to-one correspondence with a predefined semantic vocabulary.
We also respectfully disagree that the improvements are uniformly marginal. On Objaverse-LVIS (1,156 categories), AVA-3D achieves 55.8% zero-shot Top-1 accuracy, surpassing MRD-L (53.6%) while using a much smaller reported 3D backbone (32.5M vs. 306.7M parameters). On real-scanned ScanObjectNN, it improves over DuoDuoCLIP from 60.7% to 65.2%. On OmniObject3D (190 real-scanned categories), class-level text-to-shape R@1 rises from 23.96% to 39.12% relative to DuoDuoCLIP. These results establish practical benefits without implying fixed semantic identities for individual slots.
Implicit attribute learning also offers flexibility: rather than constraining evidence to a fixed attribute vocabulary, MoA can capture different combinations of cues across objects and viewpoints. The low mean pairwise cosine similarity (0.19) between slot profiles supports differentiated preferences, although it does not guarantee explicit semantic grounding. As discussed in limitation section, we will explore semantic supervision or lightweight attribute constraints to improve interpretability and consistency while retaining this flexibility.