- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes WISE-GRPO, an annotation-free process reward framework for multimodal e-commerce relevance classification. The key idea is to evaluate intermediate reasoning prefixes based on whether a committee of weak models can recover the ground-truth label from them. The method combines answer-masked prefix continuation, weak-model ensemble scoring, and progressively weighted process rewards within GRPO.
Critical strengths
The idea of using independent models to assess the usefulness of intermediate reasoning without requiring human step-level annotations is practically appealing. The paper also includes several controlled analyses and ablations to examine the proposed reward mechanism.
Critical weaknesses
The main idea on whether an intermediate reasoning prefix enables a correct final answer is closely related to prior work on automatic process supervision, including Math-Shepherd, Rewarding Progress, and Free Process Rewards Without Process Labels. These methods have already explored deriving intermediate rewards from downstream outcome correctness without requiring human step-level annotations. Much of the contribution appears to be adapting established ideas to multimodal e-commerce relevance classification.
Although the paper compares against SFT, PC-DPO, outcome-only GRPO, and a static supervised-PRM baseline, it does not directly compare against existing automatic process reward methods such as Math-Shepherd, Rewarding Progress, or implicit process reward approaches.
Despite presenting a general approach to annotation-free process rewards, the experiments are restricted to e-commerce relevance classification. Three of the four benchmarks are internal industrial datasets, and only Amazon ESCI is publicly available. The evaluation uses just two relatively small multimodal backbones, Qwen2.5-VL-3B and Qwen3-VL-4B, with single-seed results.
Questions for authors
How does WISE-GRPO compare with existing annotation-free process supervision methods such as Math-Shepherd, Rewarding Progress, and Free Process Rewards Without Process Labels?