- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies the vehicle routing problem, where a sequence of actions corresponds to a sequence of edges connecting a graph. In vehicle routing tasks, the action space is often masked because the roads will not allow the vehicle to go in any direction at any time. The authors posit that when learning to navigate this graph fails, the mask hides the cause of the learning failure.
The authors train an attention-based autoencoder using REINFORCE across two variants. From what I understand, one variant is fully observable and one is partially observable. Both approaches result in a "quality deficit". Adding a recurrent model (memory) seems to improve results.
Critical strengths
There might be some nuggets of useful information here hidden beneath AI-prose, but I struggle to find them.
Critical weaknesses
This paper has undergone heavy AI-editing that makes it very difficult for human readers to understand. Consider the first two sentences of the abstract:
Learned routing policies act under a correct feasibility mask, yet can still rank feasible actions poorly. We show that such a quality failure has more than one source, and that a correct mask hides which one: the deficit depends on where the decision-relevant information that the decoder observation aliases resides.
It is unclear what the policies are "routing" (e.g., LLM, MoE?), what a "feasibility mask" is, what it means for the mask to be "correct", what a "quality failure" is, and so on. Of course, these are just the first two sentences of the abstract. The problem repeats itself throughout the entirety of the paper.
Beyond the dense writing, the contribution and novelty is unclear. It seems like the authors found that memory (recurrence) helps to solve POMDPs, and somehow associated this with action masking. It is well known that memory provides a solution to POMDPs.
Questions for authors
- What does it mean for an autoencoder to be trained using REINFORCE? A REINFORCE objective uses the return but an autoencoder objective uses reconstruction.