- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes Preference-Gated Dual Attention (PGDA), which allows the preference vector to further control representations after attention aggregation. It uses a preference FFN and a gate FFN that takes the context, preference, and attention output as inputs, and applies dimension-wise gating to attention outputs in both the encoder and decoder. Experiments cover three MOCO benchmarks, multiple backbones, POCCO integration, cross-scale generalization, and instance augmentation, using normalized HV, Gap, and inference Time as the main metrics.
Critical strengths
None
Critical weaknesses
The novelty is insufficiently established. PGDA essentially applies a preference-conditioned feature gate to the output of standard attention. The paper does not clearly establish a substantive technical distinction from these existing approaches, nor does it provide sufficiently convincing comparisons to demonstrate that PGDA constitutes a meaningful methodological contribution.
The experimental evaluation raises serious concerns about the reliability and interpretability of the reported results. The experimental setup appears to closely follow POCCO, including the benchmark settings and even the presentation style of several figures. However, unlike POCCO, which explicitly defines Gap as the relative difference between a method’s HV and the HV of POCCO-W, this paper does not clearly specify what its reported Gap is measured against. More concerningly, the reported Gap values are not consistent with those in the original POCCO results, while many datasets report a Gap of 0.00% without even providing a clear reference value that could explain how this number is obtained. As a result, it is unclear how the reported Gap values were computed or how the experiments were actually conducted. This lack of a clearly defined and reproducible evaluation protocol makes the reported results difficult to independently verify and raises substantial concerns about the reliability of the experimental data.
Questions for authors
At this stage, I have substantial concerns about both the contribution of this paper and the validity of its experimental evaluation. I would appreciate further clarification from the authors to establish the originality and independence of their work, particularly given its close resemblance to POCCO in both the experimental setup and presentation. More importantly, the authors should provide sufficient details and evidence to clarify how their experiments were conducted and how the reported results were obtained, so that the work can be independently verified and distinguished from simply reproducing or closely imitating POCCO.
7 comments
Reponse to CW: The experimental evaluation raises serious concerns about the reliability and interpretability of the reported results.
Response CW2
Thank you for this comment. We have clarified the HV Gap calculation, disclosed the reference values used for each benchmark, and documented the evaluation procedure to make the reported results independently verifiable.
1. How are the reported Gap values calculated?
Different neural MOCO studies use different Gap reference conventions. To ensure consistent comparisons, we reconstruct a benchmark-specific zero-Gap reference HV from the published HV and Gap pairs in WE-CA (Chen et al., 2025).
Specifically, we use WS-LKH for Bi-TSP, Tri-TSP, and KroAB; MOEA/D for Bi-CVRP; and WS-DP for Bi-KP. The calculation is:
For example, on Bi-TSP20, WE-CA reports WS-LKH with HV = 0.6270 and Gap = 0.02%, yielding a reconstructed zero-Gap reference HV of 0.62713.
Representative reference values are shown below.
| Benchmark | Reference method | Reported HV / Gap | Zero-Gap HV |
|---|---|---|---|
| Bi-TSP20 | WS-LKH | 0.6270 / 0.02% | 0.62713 |
| Bi-TSP100 | WS-LKH | 0.7090 / −0.33% | 0.70665 |
| Bi-CVRP20 | MOEA/D | 0.4255 / 1.07% | 0.43010 |
| Bi-KP100 | WS-DP | 0.4532 / 0.02% | 0.45329 |
All methods on the same benchmark are evaluated against the same reconstructed reference. Consequently, differences from POCCO's reported Gap values result from different reference conventions, not changes to the underlying HV results. Reported Gap values of 0.00% may also arise from rounding to two decimal places.
The complete reconstruction for all 17 benchmarks is provided in the revised Appendix O, “HV Gap Calculation in the Main Text” (Table 16). We have also clarified the evaluation protocol in Section 5.1. The additional OOD benchmarks in Appendix K explicitly use their own WS-LKH-relative Gap convention.
2. Why do some figures resemble those in POCCO?
We follow visualization conventions widely used in neural MOCO research because they facilitate cross-paper comparisons and make benchmark results easier to interpret.
Importantly, our manuscript also provides PGDA-specific analyses beyond standard performance visualization:
-
Figure 1: PGDA architecture and post-attention gating mechanism.
-
Figure 4: Component and preference-only gating ablations.
-
Figures 6–7: Cross-backbone effectiveness and architectural sensitivity.
-
Figures 9–11: Learned feature modulation, policy entropy, and controlled decoding interventions.
These figures directly examine PGDA's architecture, behavior, and effectiveness rather than reproducing POCCO's analyses.
Overall, the revised manuscript now provides explicit Gap definitions, complete benchmark-specific reference values, and additional PGDA-specific analyses. These revisions make the reported results easier to reproduce, verify, and distinguish from previous work.
Response to Question
Response Question
We have strengthened the manuscript to clarify PGDA's independent contribution, experimental procedures, and reproducibility.
1. Originality and independence. Unlike POCCO's conditional computation and pairwise preference learning, PGDA introduces preference-guided post-attention modulation conditioned on the context, attention output, and preference representation (Section 4.2, Figure 1; Appendix E, Propositions 1–3).
Importantly, PGDA also improves CNH and WE-CA independently of POCCO (Appendix G, Figure 6). Further evidence includes the preference-only ablation (Figure 4), parameter-matched WIDE control (Appendix N, Tables 14–15), and controlled gate analyses (Appendix J, Figures 9–11). These experiments distinguish PGDA's contribution from simply increasing model capacity or reproducing POCCO.
2. Experimental reliability and reproducibility. We have clarified the training and evaluation protocols in Sections 4.3 and 5.1 and Appendix B. To eliminate hardware-related runtime inconsistencies, we re-evaluated all POCCO-C/W baselines and their PGDA variants on the same 48-GB vGPU, using single-GPU inference and matched evaluation settings. All corrected inference times are reported in Tables 1–2 and the corresponding appendix results.
We also explicitly define HV Gap and provide the complete benchmark-specific reference values reconstructed from WE-CA in Appendix O (Table 16), enabling independent verification. Appendix P further documents the provenance of existing assets.
3. Experimental presentation. We adopt established neural MOCO visualization conventions to facilitate cross-paper comparisons. The manuscript also includes PGDA-specific architectural illustrations, ablations, feature analyses, and controlled decoding interventions that go beyond standard performance comparisons.
Overall, PGDA is methodologically distinct from POCCO, and the revised manuscript provides targeted experimental controls, standardized runtime measurements, and explicit evaluation references to substantiate its contribution and the reliability of its results.
Reponse to CW: The novelty is insufficiently established
Response CW1
Thank you for this comment. PGDA's contribution is not element-wise multiplication itself, but a preference-guided, context- and output-aware post-attention mechanism that directly modulates attended features for neural MOCO.
1. Methodological distinction. As shown in Figure 1 and Section 4.2 (Eqs. (5)–(8)), PGDA generates gates jointly conditioned on the pre-attention context (X), attention output (Y), and preference representation (\mathrm{Pref}):
\widetilde{Y}=g\odot Y.$$ Unlike methods that primarily inject preferences into representations or select computation paths, PGDA modulates attention outputs while retaining the standard QKV attention computation. **Appendix E (Propositions 1–3)** further analyzes its distinction from conventional gating, residual-aware modulation, and preference-conditioned gradient filtering. **2. Experimental evidence.** We provide four complementary validations: - **Preference-only ablation (Figure 4):** Full PGDA outperforms preference-only gating on all five Bi-TSP scales, including **0.7356 vs. 0.7300** HV on Bi-TSP200. - **Parameter-matched control (Appendix N, Tables 14–15):** PGDA outperforms the capacity-matched POCCO-W-WIDE baseline in **10 of 14 settings**, with three ties and one lower result. - **Mechanism analysis (Appendix J, Figures 9–11):** Learned gates modify attended features, policy concentration, and actual next-node decisions under controlled interventions. - **Generality (Appendix G, Figure 6; Appendix K, Tables 9–10):** PGDA works across CNH, WE-CA, and POCCO-based backbones. On euclidAB500 and clusAB500, POCCO-W-PGDA improves HV from **0.7860 to 0.7975** and **0.8517 to 0.8624**, respectively. **Together, these results establish that PGDA offers a distinct preference-conditioned attention modulation mechanism whose benefits cannot be explained solely by increased parameter capacity.** The revised manuscript now provides both theoretical distinctions and targeted experimental controls to substantiate this contribution.