- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates the difference between selective retrieval and broad retrieval by distinguishing the model capacity and effectiveness of training. My overall rating is 1/4 towards rejection.
Critical strengths
The problem is interesting and popular. The most valuable contribution of the paper is the curriculum training in Table 3 which shows that the PR accuracy of standard Mamba-3 improved from approximately 0.015 to 0.72 and this could be transferred to MQAR.
Critical weaknesses
-
The presentation is difficult to follow and appears to rely heavily on AI-generated text without human explanation. In particular, section 3 need a clear mathematical formulation and well-defined notations.
-
The insights of introducing the leverage budget are unclear. The experiments do not appear to verify the theoretical rank bounds in Section 3.
-
Figure 6 shows that increasing model width can reduce broad retrieval accuracy. Maybe the authors could discuss possible reasons for this interesting behavior.
Questions for authors
Plz see weaknesses.