- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper argues that internal training signals alone cannot tell you whether to intervene. So it proposes PRISM: fork matched continuations from one checkpoint under different interventions, then compare mechanism, quality, and cost. It also proposes protected-summary recovery, which rebuilds damaged Adam second moments from one stored scalar per tensor and intact momentum.
Critical strengths
The recovery method is easy and cheap:
Critical weaknesses
It is unclear how short controlled continuations represent later training. The reported gains are tiny, about 1e-3 NLL, and mostly fade as training continues. The conclusions also do not transfer, so the comparison must be trained for each model, even stage, and fault. This overhead from my view is too high.
Questions for authors
How are fork points and candidate interventions chosen in a real run?