- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper formulates marginal continuation selection: after a model has undergone an initial stage of tool-use supervised fine-tuning (SFT), select a second-stage subset from the remaining records under a fixed serialized-token budget.
Critical strengths
None
Critical weaknesses
- Fatal for the main contribution: no experiment demonstrates model-state-aware residual allocation.
- The empirical advantage is small, uncertain, intervention-dependent, and very narrow.
Questions for authors
Evidence request: Can the authors provide a fully frozen evaluation on a new, untouched confirmation surface in a regime where state-specific deficit magnitudes actually produce different selected memberships? A decisive test should report the selected IDs per state and compare CAMS against an unweighted both-demand/static-intersection selector, shuffled demands, and multiple hash tie-break seeds under the same supervised-label count, update count, sequence/context exposure, and scheduler endpoint. Paired per-example uncertainty for CAMS–Random and CAMS–static should also be reported. Without such evidence, what empirical result in the submission isolates any benefit from model-state-aware weighting?