- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies two important issues in self-evolving multimodal models: model consensus is not always reliable, and model uncertainty does not necessarily indicate that a question is useful for learning. The paper separates these two problems into “what to trust” and “what to learn,” and addresses them with external visual evidence and actual learning progress, respectively. I find this decomposition natural and conceptually useful.
Critical strengths
I like the overall idea of the paper. The experiments make a convincing case that relying only on the model’s own consensus can reinforce its mistakes, while an independent grounding signal can provide more reliable supervision. I also find the progress-based Proposer more conceptually aligned with the goal of curriculum learning than simply rewarding uncertainty or entropy. I do not view the use of a frozen detector as a major weakness. It serves a clear purpose, does not introduce inference-time overhead, and provides a source of supervision that is independent of the Solver’s own predictions. The paper is also reasonably transparent about the detector being imperfect and about the current method mainly covering spatial and object-relation skills.
Critical weaknesses
My main concern is about how much of the paper’s contribution should really be attributed to “self-evolution”. The most convincing part of the method appears to be the grounded target itself, while the additional gain from learning the Proposer is noticeably smaller. This does not make the method less useful, but I think the paper should be more careful in separating the contribution of reliable external supervision from the contribution of learning a better curriculum. A second concern is that the Proposer is repeatedly trained using the same fixed set of probe questions to measure learning progress. From the Proposer’s point of view, these probes are part of its training signal. It is therefore unclear whether the Proposer learns a general notion of “what is useful to teach”, or simply learns what works well for this particular probe set. I think this is the main point that currently limits the strength of the “what to learn” claim.
Questions for authors
- Does the advantage of the learned Proposer remain if its usefulness is evaluated on a fresh probe set that was never used to generate Proposer rewards? A rotating or separate held-out probe set would make the “learning what to teach” claim much more convincing.
- How do the authors interpret the relative importance of the two components? In my reading, the strongest result is that grounded supervision is substantially more reliable than self-consensus, while the learned curriculum gives a smaller but still meaningful additional gain. I think stating this distinction more explicitly would make the paper stronger rather than weaker.
- It would also be useful to report the rough training overhead of the paired-progress procedure. I do not consider the detector itself problematic, but the extra Solver trial updates and probe evaluations are part of the practical cost of the full method.