- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ANVIL, a framework for improving spatial intelligence in VLMs through three components: ANVIL-GEN, which generates and verifies spatial supervision using cross-form consistency and feedback-driven repair; ANVIL-BEN, which organizes 5.8M records across 11 spatial task formats; and ANVIL-MOPD, which introduces semantic-first-fault routing for selective multi-teacher distillation. The authors further propose knowledge recirculation, where the trained student assists subsequent data generation and verification.
Experiments show a 9.29-point average improvement over Qwen3.5-9B across seven benchmarks, alongside component-level evidence for targeted supervision, selective teacher routing, feedback-driven repair, and scene-linked spatial learning.
Critical strengths
-
- Structured spatial supervision for embodied intelligence
The paper introduces ANVIL-GEN, a unified framework for constructing and verifying Ground–Relation–Action supervision through scene-aligned annotations and cross-form consistency checks. This provides a meaningful approach to organizing heterogeneous spatial knowledge and supporting compositional learning across embodied tasks.
- Structured spatial supervision for embodied intelligence
-
- Stage-aware multi-teacher distillation
ANVIL-MOPD introduces semantic-first-fault routing, which identifies the earliest erroneous stage in student predictions and selectively applies supervision from the corresponding specialist teacher. This task-dependency-aware training strategy is a meaningful methodological contribution, with controlled experiments showing improvements over flat distillation.
- Stage-aware multi-teacher distillation
Critical weaknesses
-
- Insufficient validation of knowledge recirculation
Despite being the central claim of the paper, no end-to-end experiments demonstrate that the distilled student improves subsequent data generation or verification, or that the resulting data further improves the student. The reported repair experiments instead use a separate model, leaving the proposed iterative feedback mechanism unvalidated.
- Insufficient validation of knowledge recirculation
-
- Insufficient evidence for the necessity and superiority of ANVIL-MOPD
Although semantic-first-fault routing improves over flat distillation, its advantage over simpler declared routing is marginal (+0.53 percentage points) and statistically inconclusive. Furthermore, the paper lacks comprehensive ablations against standard SFT and alternative distillation strategies, making it difficult to attribute the final performance gains to the proposed method.
- Insufficient evidence for the necessity and superiority of ANVIL-MOPD
-
- Limited evidence of successful specialist-to-generalist knowledge consolidation
ANVIL-MOPD aims to integrate Ground, Relation, and Act specialist knowledge into a unified student. However, the paper lacks systematic comparisons between the specialists and the final student across the 11 spatial tasks. Moreover, the linked-supervision experiments reveal substantial degradation on atomic tasks, raising concerns about whether the learned spatial capabilities are genuinely consolidated and transferable rather than adapted to specific output formats.
- Limited evidence of successful specialist-to-generalist knowledge consolidation
Questions for authors
Beyond the concerns raised in the weaknesses, I have an additional question regarding the generalizability of the reported improvements. The average gain (in Table 1) is largely driven by Where2Place (+20.03 points) and VABench-Point (+38.34 points), while improvements on several other benchmarks are marginal, and RefSpatial even shows a performance decline. Could the authors clarify whether this imbalance is related to the distribution of training tasks or the alignment between training supervision formats and benchmark output requirements? A more detailed analysis would help determine whether the improvements reflect generalizable spatial reasoning capabilities or are primarily driven by adaptation to specific task formats.