- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HGI-RL, a training framework for neural multi-objective combinatorial optimization that accounts for both individual solution quality and contribution to set coverage. For candidates generated under the same problem instance and preference, it computes each candidate’s exclusive hypervolume contribution and uses this to redistribute positive scalarized advantages, preserving their total sum and leaving non-positive advantages unchanged. The adjusted advantages remain fixed during multiple PPO updates on the same trajectories. The method requires no additional trainable parameters or changes to inference. Experiments on multi-objective traveling salesman, vehicle routing, and knapsack problems show competitive hypervolume performance, with modest improvements over standard PPO on routing tasks.
Critical strengths
- The method distinguishes a solution’s scalarized quality from its unique contribution to set coverage, addressing a relevant limitation of conventional training.
- The fixed-backbone PPO comparison isolates the redistribution mechanism, while experiments with WE-CA and CNH demonstrate applicability beyond the proposed backbone.
Critical weaknesses
- Hypervolume-guided training, candidate-level advantage reweighting, and trajectory reuse have precedents. The main addition is the specific rule that redistributes positive advantages while preserving their sum.
- Insufficient comparison with the closest alternatives. NHDE and CDE are discussed but not evaluated. Comparisons with direct hypervolume rewards and simpler advantage adjustments are also missing, leaving the benefit of the particular formulation unclear.
Questions for authors
- Why restrict redistribution to positive advantages and preserve their total sum? How does this compare with directly adding a hypervolume bonus?
- How does HGI-RL compare with NHDE and CDE under matched training and inference budgets?
- Given the small hypervolume gains over PPO and the tie on knapsack, could the authors report results across multiple independent training seeds, with standard deviations or confidence intervals, to establish whether the improvements are reliable?