- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Paper Summary ProVIC assigns call-specific advantages to visual-tool actions using final-answer rewards. It represents acquired observations and their provenance in a persistent evidence graph, then compares returns among rollouts with matched prior evidence and tool outcomes. On five benchmarks with Qwen3-VL-8B-Instruct, it improves the mean score from 56.4 (GRPO) and 57.1 (BiPACE) to 58.4.
Critical strengths
- Well-motivated matching rule: Provenance distinguishes identical values obtained from different regions or calculations, while the evidence set allows matching across acquisition orders. This directly addresses a weakness of history- and value-based grouping.
- Consistent controlled gains: ProVIC leads all matched RL baselines on all five benchmarks and in each of five paired training seeds. The crossed ablation and replay diagnostic strengthen the case that grouping and credit estimation both contribute.
Critical weaknesses
- Unclear effective coverage of local credit: The paper does not report how often calls receive content-, region-, or source-level matches versus falling back to trajectory-level GRPO. Without these rates and group sizes, it is difficult to tell how broadly the proposed credit mechanism operates.
- Limited transfer evidence: All training results use one 8B backbone, one executor that supplies structured provenance, and an eight-call limit. The method’s utility with less reliable provenance or longer interactions remains untested.
Questions for authors
- What fraction of training calls use each matching level or GRPO fallback, and what are their context and transition group-size distributions?
- How do performance and match coverage change when executor provenance is missing or noisy?
thank you for your reply.
My problem is partially solved, but the contribution of this work is not sufficient to support a positive score
I will keep my score.