- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose Sylva, a neuro-symbolic supervision system for latent reasoning vision language models. This is a 3 staged training approach which compositionally builds symbolic meaning into latent tokens from local grounding to latent chain consistency to full execution accuracy. Their first stage maps knowledge triplets into each latent step. The second stage then clusters triplets into typed probabilistic scene graph which executes the supervising first order logic program differentiably. The last stage performs a GRPO-style reinforcement learning on the final answers by sampling the scene graph and text and rewarding both with a weighted reward. They report state of the approach results on 5 our of 6 benchmarks evaluated.
Critical strengths
The three stages all have reasonable justifications and designs. It logically follows that each stage ought to follow the previous, and that the differentiable FOL execution and the discretely sampled RL stages would compliment each other. The explanations are lucid and the figures provide appropriate context.
While many of the components of this submission are closely related to previous work, the combination of techniques are novel. The use of Hungarian matching for stage 2 label generation in latent VLMs is a meaningful contribution. I can appreciate the use of sampling in stage 3 to preserve boolean semantics necessary for RL, because it may be tempting to attempt to maintain the soft logic approach in stage 2 into stage 3.
Critical weaknesses
My main concern is the lack of out-of-distribution evaluation. The problem with approaches like Sylva tend to be overfitting to the domain and heavily leaning on the ground truth data's ontologies. It would be beneficial to the defense of the claims to demonstrate that these results hold on benchmarks or entities/predicates/operators outside of the training data.
Stage 1 is essentially the same as the cited ReGuLaR approach. The question then becomes "is the performance advantage from the novel training, or simply additional training?" I recommend evaluating an additional baseline that continues ordinary SFT from stage 1 without either symbolic loss. That would more cleanly isolate the performance effect between the training budget and the training objective.
Two similar approaches deserve a citation in your related works: SAGE https://arxiv.org/abs/2607.05716 and APEIRA https://arxiv.org/abs/2606.01215
It would be nice to see some sort of intervention or experiment to demonstrate that the VLM's language decoder is actually using the symbolically enhanced latent representations to carry out logical operations. Showing a controllable/steerable manipulation effect on one of these latent steps would provide good evidence that the claimed symbolic reasoning is actually happening, rather than focusing solely on the improved performance.
Questions for authors
Given the reliance on annotated entities, relations, and FOL programs, can the authors provide an out-of-distribution evaluation, particularly on held-out combinations of concepts and relations or benchmarks outside the training distributions? This would help establish whether the gains reflect generalizable compositional reasoning rather than adaptation to the training ontology.
Can the authors evaluate a baseline that continues ordinary SFT from the Stage 1 checkpoint, using the same Stage 2 data and training budget, but without either symbolic loss? This would help isolate the contribution of the proposed symbolic objectives from the benefits of additional fine-tuning.
Since the symbolic executor is removed during inference, is there evidence that the language decoder actually uses the symbolically grounded latent representations for logical reasoning? Could the authors perform a targeted intervention, such as manipulating an entity or relation representation in a latent step, and demonstrate a corresponding, predictable change in the generated answer? This would help distinguish learned symbolic reasoning from improvements due to auxiliary representation supervision.