- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SCOPE, a framework for tuning the inference pipeline around a frozen video model (Wan2.2-5B and CogVideoX). The pipeline is split into text, sampling, verification and selection, an agent edits one of them at a time, and an edit is kept only if it helps on development data and passes some guard checks. Everything is frozen before testing and logged with a hash chain. In practice the system rewrites prompts with GPT-5.4 (physics cards), changes CFG/steps a bit, and picks one of ~3 candidates with a small ridge regressor. On Physics-IQ (Wan2.2, 40 scenes) it goes from 20.70 to 34.94.
Critical strengths
The motivation makes sense, test-time pipelines usually change many things at once and it's hard to tell what actually helped. The authors are also quite honest, they report a lot of null and negative results, and they separate the gain from having more candidates vs. better selection in Table 1.
Critical weaknesses
- Most of the improvement comes from the prompt. Just adding the GPT-5.4 physics card takes Wan from 20.70 to 30.04, and after that the CIs in Fig. 2 mostly overlap.
- SCOPE doesn't significantly beat the strongest baseline (Qwen-style agent on the same candidate pool).
- More importantly, I think what the paper performed is mostly prompt rewriting, a CFG/steps tweak, and best-of-3 with a learned scorer. These are all standard test-time tricks.
Questions for authors
N/A