- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
GOMA addresses different relevance targets in multimodal retrieval: matching an object's own image and text, retrieving another object in the same category, and ranking related objects. It learns content and semantic embeddings with different supervision, uses semantic similarity to weight observed graph edges, and applies restart propagation. A task-specific readout supports four tasks. Across six datasets, the paper reports leading results on 14 primary measures and includes component and representation analyses.
Critical strengths
-
The paper starts from an interesting distinction: graph neighbors need not be uniformly close for every retrieval target. Separating identity from cross-object semantics makes the task formulation and readout convincing.
-
The empirical evaluation is extensive. Results are consistent on the primary measures, and the ablations examine supervision placement, graph regularization, and propagation.
Critical weaknesses
1.The novelity is limited. The method combines established representation learning, graph smoothing, and restart propagation techniques, so its advance over a closely matched simpler model remains unclear.
2.Several graph baselines require substantial adaptation for single-modality retrieval, making the improvements over those methods harder to interpret.
Questions for authors
-
If you retrain a matched model with the same embeddings, losses, and restart propagation but uniform edge weights, how much improvement remains on each task?
-
How did you verify that the single-modality adaptations preserve the graph baselines’ capabilities, and can you provide a comparison using a baseline designed for the same inference interface?
5 comments
W2 and Q2(a). We corrected a training–inference mismatch and replaced the affected single-modality results in Tables 1 and 5–6. Ten graph adapters optimized paired retrieval on graph outputs but were evaluated on independently encoded attributes. The corrected adapters retain graph computations and method-specific auxiliary objectives, and average paired retrieval losses on graph outputs and independent outputs. The independent training computation is the one used at inference. DGF directly supervises its independent modality outputs.
The single-modality input rule is the same for every method, including GOMA: each query and candidate uses only its own visible attribute, without the missing attribute or evaluation-time neighbors. Graph information is available during training. We checked the adaptations against their sources: GCN/GAT/GraphSAGE/LGMRec retain the retrieval cores supplied by OpenMAG [1], with our independent-input changes identified separately; CoMAG retains its full multihop matcher; RoleMAG uses its original multihop recurrence; and DMGC uses its prescribed category counts. Appendix F.3 describes the current computations and supervision.
The corrected retrieval results provide direct performance evidence alongside these source checks. GCN/Grocery semantic mAP@10 increases from 8.86 to 32.04, and DMGC/Reddit-S from 50.60 to 56.18 (three-seed means). The corrected adapters receive up to 1,000 updates and task-specific validation selection; GOMA retains its 500-update cap and one jointly selected checkpoint. Against the corrected comparisons, GOMA leads the four single-modality semantic tasks by 2.61/3.56/7.62/2.84 points on Grocery/Reddit-S/Toys/Books.
Q2(b). VSE++, CLIP-Refine, and SigLIP directly match the independent-attribute inference interface. Their objectives cover hard-negative matching [2], contrastive modality-alignment distillation [3], and pairwise sigmoid matching [4]. Like GOMA, each encodes a query or candidate from its own visible attribute without an inference graph. They use the same frozen features, partitions, candidates, and metrics. Validation selects their task-specific learning rates and checkpoints; GOMA retains one model per dataset/seed for all tasks. Appendix H.3 specifies the baseline selection and reporting rules, and H.4 the joint GOMA selection.
Tables 1 and 5–6 report both bidirectional identity R@1 and single-modality semantic mAP@10 for these independent encoders. Against the strongest corresponding semantic comparator, GOMA gains 3.43/7.07/7.62/3.41 points on Grocery/Reddit-S/Toys/Books. Against these independent encoders, GOMA also leads identity R@1 by 0.27/0.23/0.09/1.06 points on the same four datasets. Across the full main comparison, GOMA leads all 14 primary means (Tables 1–2).
References
[1] Chenxi Wan et al. OpenMAG: A Comprehensive Benchmark for Multimodal-Attributed Graph. ICML, 2026.
[2] Fartash Faghri et al. VSE++: Improving Visual-Semantic Embeddings with Hard Negatives. BMVC, 2018. [3] Shin'ya Yamaguchi et al. Post-pre-training for Modality Alignment in Vision-Language Foundation Models. CVPR, 2025. [4] Xiaohua Zhai et al. Sigmoid Loss for Language Image Pre-Training. ICCV, 2023.
Dear Reviewer 84BW,
With the rebuttal deadline approaching, we wanted to ask whether you have had a chance to read our response.
Could you let us know if the retrained uniform-weight controls and clarified baseline adaptations address your concerns?
We are happy to provide any further clarification. Thank you for your time.
Thank you for recognizing the relevance distinction and empirical evaluation. We address the matched simpler model and adaptation questions below.
Q1. GOMA's fully retrained uniform-weight ablation leads all 14 primary means against the external comparators. It retains GOMA's content-to-semantic architecture, objectives, graph regularization, fusion, and restart propagation. We trained it on all six datasets and three seeds with the same optimizer, sampling, budget, and validation rule. Only observed-edge weights become uniform before degree normalization. Each model selects its own Joint validation checkpoint (MRR for relation datasets). Both use learning rate 0.001 and α=0.1,K=8.
Sections 5.3 and 5.5 distinguish the retrained control from fixed-checkpoint interventions. The table shows its gain over the strongest external comparator, in percentage points, for every task. Full means and three-seed sample SDs are in Appendix H.1, Table 17.
These gains are retained by GOMA's learned content and semantics. Its single-modality semantic gains are already present when each query and candidate uses only its own attribute. Reusing z to guide neighborhood aggregation then adds 0.75/0.05/0.39/0.21 dual-semantic points on Grocery/Reddit-S/Toys/Books over the uniform ablation. Uniform weighting gives 0.51/0.66 higher Sports/Cloth MRR. Differences use unrounded means.
The tasks reward different matches: category retrieval seeks similar objects, whereas relation ranking can require a complementary item. GOMA's semantic guide emphasizes close semantic neighbors and improves every dual-attribute category task. With one jointly selected model per dataset/seed, GOMA thus provides the paired matching results above alongside substantial cross-object semantic gains, and reuses the same learned semantics to improve complete-record retrieval. This full-training comparison complements the fixed-checkpoint intervention in Table 12.
W1. GOMA's design connects graph-assisted alignment to the representation used for each retrieval goal. GOMA learns z from identity-supervised c using paired correspondence and graph agreement, retains both outputs for their retrieval targets, and reuses z to guide complete-record propagation. At equal capacity, separating identity supervision and scoring improves identity by 0.53–2.04 points and semantics by 3.05–7.49 over shared-output supervision (Table 4). Against a parameter-matched shared backbone with parallel task heads, GOMA leads 11/14 means under each of two loss-coefficient controls (largest gain 1.48 points; Table 17). The matched controls show the value of learning relational semantics from identity-supervised content. Reusing these semantics to guide propagation further improves every dual-attribute category task over the uniform counterpart.