- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a framework, called EvoRobust, for improving MLLM robustness to visual corruption through claim-level self-verification. The framework consists of four roles: Fact Parser, Query Generator, Voting Critic, and Credit Assigner, then uses GRPO for policy optimization. The authors evaluate EvoRobust on R-Bench and three additional synthetic-corruption benchmarks, with reward ablations examining its effectiveness and the contributions of individual components.
Critical strengths
S1. The method requires only unlabeled degraded images for training, without clean counterparts, task labels, or an external teacher, and introduces no additional verification overhead at inference time.
S2. The problem setting is practically relevant: the method constructs a training signal through claim-level self-verification for visual corruption scenarios where clean counterparts and task labels are unavailable.
Critical weaknesses
W1. The performance gains are modest, and their statistical reliability remains unclear. On R-Bench, the Overall score improves by 0.0111 over the backbone and by 0.0067 over averaged holistic self-scoring. However, each configuration is evaluated in only a single run, without multiple seeds, confidence intervals, or significance tests, making it difficult to determine whether these small differences are consistent.
W2. Averaging over extracted claims can reward the addition of claims with high agreement, while omissions are not penalized. The practical impact of this composition bias is not evaluated. It therefore remains unclear to what extent the gains reflect improved visual understanding or a shift toward more conservative descriptions that are easier to verify.
Questions for authors
Please see the questions in Weaknesses