- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes an alternating proposer–solver framework for region-grounded visual RAG. The proposer generates questions, answers, and evidence regions, while the solver trains on validated tasks it currently struggles to solve. Experiments on 317 custom questions compare this approach with continual RL and ability-boundary self-play. The reported gains are mainly in evidence localization.
Critical strengths
None.
Critical weaknesses
The experiments do not sufficiently isolate or validate the proposed mechanism. The hard-task and ability-boundary variants change both the proposer reward and the solver’s task-selection range (Section 3.5, p. 5). Table 3 provides useful ablations, but does not disentangle failure-driven proposer training from downstream task filtering. In addition, human review rejects 20.75% of an audited sample of automatically accepted tasks (Appendix C, pp. 14–15). The paper does not assess validity specifically within the selected hard-task curriculum, leaving open whether solver failure consistently identifies useful learning opportunities rather than unreliable supervision.
Questions for authors
- Could you clarify whether the frozen-proposer continual-RL baseline uses the same failure-based filtering as the proposed method?
- Could you provide any human-review results comparing the validity of selected hard tasks with uniformly sampled accepted tasks? It would also be helpful to understand how sensitive the results are to using eight samples for difficulty estimation.
- Could you specify the exact [email protected] aggregation and its relationship to Section 4.1? If available, VISA comparisons with continual RL and both self-play variants under a shared protocol would help assess generalization, particularly with retrieval failures distinguished from localization errors.