- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes using a pretrained LLM as a high-level controller for multi-task VRP training. Every 500 epochs, recent validation statistics are summarized and sent to GLM-5.1. The model outputs five scalar values, one for each elementary constraint. These values are then concatenated with the binary task vector and injected into the encoder through learnable side branches. The proposed mechanism consistently improves several multi-task neural solvers, although the magnitude of improvement is usually moderate.
Critical strengths
-
Existing multi-task VRP methods usually focus on architectures, task representations, experts, or gradients. It is a reasonable direction to explicitly process the state of multi-task training as an input signal.
-
The method is demonstrated on several backbones rather than one specific architecture. This supports the claimed plug-and-play nature to some extent.
Critical weaknesses
-
The training procedure explicitly states that, at every control round, the current solver is evaluated on all 16 validation tasks, and these validation results are supplied to the LLM to construct the subsequent guidance vector. However, only six variants are described as training variants, while the remaining ten are subsequently evaluated as “unseen VRPs” and claimed to demonstrate zero-shot generalization. Therefore the supposedly unseen task distributions have already influenced the training trajectory.
-
I am not convinced that an LLM is necessary for this problem. The MLP baseline does not resolve this concern. The appendix reports a difference of only 0.1 percentage points. This is small, particularly because the paper does not provide variance over independent training runs. Furthermore, the proposed MLP baseline is somewhat unusual. Its parameters are updated only once per control round through the first training batch of the subsequent interval. This does not strike me as the strongest learned controller baseline. Moreover, the guidance-gap correlation is descriptive, but not mechanistic. It would be helpful to compare against explicit non-LLM control rules.
-
Some reported SOTA margins are extremely small. For example, under the CaDA plug-and-play comparison, the improvement is only 0.0039 percentage points. Without repeated runs, I do not view this as convincing evidence of superiority. Moreover, the main experiments compare LaT against several recent state-of-the-art methods, such as ReLD, CaDA, and CCL, the evaluations on CVRPLIB Set-X and Set-Solomon in Appendix F.4 only include POMO, POMO-MTL, and MVMoE as baselines.
-
The paper reports low additional training time for LaT itself, but LaT requires reference objectives used to compute gaps. For 14 variants these are generated offline using OR-Tools with a time limit of up to 200 seconds per instance, while HGS is used for CVRP/VRPTW.
Questions for authors
See Weaknesses
Thank you to the authors for the detailed response and additional experiments. The new results address several of my concerns, but some issues remain unresolved.
W1. I appreciate the authors acknowledging that the original protocol was not strictly zero-shot. The new six-task-only experiment is encouraging, but it is limited to POMO-MTL at N=50. The strict zero-shot results for the main LaT-CaDA and LaT-ReLD variants are still missing. Furthermore, removing both the unseen-task feedback and the history simultaneously makes it difficult to isolate their individual effects.
W2. Contribution of the LLM. The added non-LLM baselines strengthen the evaluation. However, the improvements relative to these baselines remain relatively small and lack multi-seed validation. Therefore, it remains unclear how much of the gain specifically originates from the LLM-generated guidance rather than dynamic conditioning.
W3. Limited methodological insights. The performance improvements over strong baselines are often marginal, and the paper provides limited insight into why the LLM-generated guidance improves the optimization process. The guidance values are introduced as additional conditioning inputs, but it is not clearly explained how they reduce cross-task interference or enhance task-specific learning.
Overall, I acknowledge the authors' efforts and the improved empirical evidence. However, the remaining issues prevent me from increasing my score. I will maintain my rating.