- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 1
Read review
Paper summary
Inference time methods can help models improve performance, but it's hard to incorporate those strength. Namely, during OPD, selecting which context to distill is challenging. The paper proposes E2L to solve this.
Critical strengths
-
The core problem is timely and important. During OPD, selecting which context to distill can be challenging. Authors made contributions by providing insights into this.
-
The authors tried to provide many experimental details and some theoretical motivations.
Critical weaknesses
-
While the topic is interesting, I found the soundness to be very limited. There are many such evidence in the paper (such as number inconsistencies between tables). I just mention one of them: On AIME25, AIME26, LiveBench Math, and HotPotQA, it seems like the performance difference between GEPA-OPD and E2L is very small. Also it's an over-claim to use self-improvement, as the method need better external models such as Qwen3.7-Max.
-
The presentation is unclear. Examples:
(1) The introduction section is without a title.
(2) The authors mixed the usage of \citep and \citet.
(3) Figures look unpolished. In Figure 1, there are many small grey words that should not be included in an acedemic paper.
(4) Conclusion should appear after related work.
Questions for authors
-
Revise writing substantially.
-
Revisit experiments to check if the performance gain is significant. Currently it's not statistically better than baselines.