- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes EnergyViG, a Vision GNN framework that dynamically refines graph structure. Its Decoupled Energy Learning objective decomposes a joint energy model over augmented graph views into a discriminative InfoNCE term and a generative EBM term estimated with Langevin sampling. Pairwise similarities are converted into a relaxed adjacency matrix using Gumbel-Sigmoid. Experiments report improvements on ImageNet-1K, MS COCO, and ADE20K.
Critical strengths
- Dynamic graph refinement is relevant for Vision GNNs, where fixed k-NN structures may contain noisy or missing connections.
- The evaluation covers classification, detection, instance segmentation, and semantic segmentation.
- The paper reports ablations on loss components, edge addition and pruning, Langevin iterations, and integration with different ViG backbones.
Critical weaknesses
- The theoretical claims are overstated. In Eq. (4), the energy is bounded because the representations are unit-normalized. Thus, over the unbounded sampling space implied by Eq. (3), the partition function in Eq. (4) may diverge; the same issue affects the marginal EBM in Eq. (7). Moreover, Appendix A.1 treats the contrastive-divergence estimator in Eq. (11) as an exact likelihood objective, ignoring the dependence of samples from on unless they are explicitly stop-gradient. Finally, the convergence claim following Eq. (3) is not justified by the five Langevin steps used in practice (Fig. 3 and Appendix C.3).
- The novelty over ECL-GSR is unclear. Zeng et al., Graph Structure Refinement with Energy-based Contrastive Learning , AAAI 2025, 39(21):22326–22335, DOI: 10.1609/aaai.v39i21.34388, already combine generative EBM training, contrastive learning, and similarity-based edge refinement. Several central equations and the overall pipeline closely resemble ECL-GSR. The paper does not clearly isolate DEL’s new contribution or provide a direct adaptation baseline.
- The motivation for unifying generative and discriminative learning is insufficient. All evaluated tasks are discriminative, while no generative capability is evaluated. The paper does not explain what limitation of InfoNCE-based structure refinement requires marginal generative modeling.
- The presentation lacks precision. For the motivation section, “Comprehensively enhancing performance” is not a meaningful scientific motivation. Describing MNIST and CIFAR as “toy datasets” is dismissive and does not clarify the methodological challenge.
Questions for authors
My questions and concerns have already been presented in the Critical Weaknesses section.
Dear reviewers,
If you believe the authors have addressed your questions, please respond to the rebuttal.
Best, AC