- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper finds that, during the inference phase, removing or adding noise to the visual reasoning processes generated by the model itself has a negligible impact on accuracy across nine benchmark tests. Based on this observation, the paper proposes a policy-based automated distillation method called Visual-OPSD. This approach not only outperforms the ThinkMorph model but also reduces the processing time per sample.
Critical strengths
-
The authors found that removing the visual thoughts automatically generated by ThinkMorph during the inference phase has almost no impact on accuracy.
-
This method requires no changes to the model architecture, outperforms the text-only mode of the same model, and reduces the output length by approximately half.
Critical weaknesses
-
The paper states that Visual-OPSD incorporates knowledge distillation into the reasoning process. According to Algorithm 1, the teacher model does not actually utilize the generated paths.
-
The speed improvement is primarily attributed to the disabling of the diffusion mechanism. The paper does not address the inherent latency issues of the ThinkMorph text-only model itself.
Questions for authors
-
In the teacher context, do the VT images refer to the reference visual texts from the dataset, or are they images generated by ThinkMorph itself
-
Given the same dataset and comparable computational resources, could you provide baseline results for SFT, RFT, or RL models initialized using ThinkMorph
Summary for the Area Chair
We have addressed the reviewers’ questions in our point-by-point replies and revised the PDF to incorporate the new experiments and clarify the paper’s claims.
In controlled experiments, ThinkMorph largely retains its benchmark accuracy when we remove its intermediate images at inference or replace them with noise. We find a useful role for visual thoughts in training. Conditioning the same model on reference visual thoughts changes its next-token predictions on identical completions, and distillation with that context yields higher accuracy than a matched noise control. Visual-OPSD turns these predictions into supervision along the student’s own reasoning trajectories, so the student learns to reason in text from the original image and question.
We thank the reviewers, Area Chair, and Senior Area Chair for their time and constructive feedback. Their questions helped us strengthen the experimental comparisons and make the paper’s claims more precise