- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Soap2Soap looks at cinematic remaking, which mean changing how the characters look or the visual style while keeping the source video's story and shot structure. To do this it put together a structured screenplay, visual references that persists across shots, keyframes generated jointly in grid, and verification loop. The SoapBench benchmark test understanding on 607 shots and remaking on ten movie excerpt. Both the automatic metrics and a blinded human study comes out in favor of the proposed system.
Critical strengths
I find the task useful, and the motivation is clear. If you change the cast or the style of a sequence but still keep its story, you end up with real consistency problem. Keeping the narrative instructions apart from the visual references that persists across shots seem like a practical way to organize it. The results also doesn't rely only on the automated evaluator. Table 1 show big gains in identity consistency, and the randomized, anonymous comparison with 20 participant gives decent evidence that viewers actually prefers these outputs too.
Critical weaknesses
1.The remaking evaluation only use ten excerpts, each 1.5 to 5 minute long, and none of them have more than 42 consecutive shot. The 607-shot number is for understanding part, not for continuous remaking. So the results do back up multi-shot remaking, but they doesn't yet show that the method stay consistent at the scale of an episode or a film, with hundreds of shots. 2.In the main comparison, the generation models changes along with the workflow. The ablations takes out memory allocation or verification, but there's no separate test of grid generation, and no comparison with simpler pipeline that use the same generators. The paper also don't say how many retry were actually used. Because of these gap, it's hard to tell how much of the gain come from the proposed design and how much from stronger models and extra generation attempts.
Questions for authors
1.Is there any evidence that the remaking work beyond the 42-shot sequences reported in paper? If longer sequence weren't evaluated, would the authors consider scaling back the claims so they matches what the experiments actually show? 2.If you keep the same Nano Banana 2 and Veo 3 models, the same references, and same generation budget, how does Soap2Soap does against a simpler pipeline that just condition on the references? It would also help to know how much grid generation contribute on its own, and how many retry are needed on average.