- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors proposed a method for consistent video retrieval. The authors try to seperate persistent visual context from procedural transitions. They transfer transition codes across different videos and use the receiver video continuation as supervision. The method also uses donor negatives, wrong-transition constraints, and relational losses. The authors test on YouCook2 and CrossTask with frozen CLIP features. The results show some clear improvements over their factorized baseline. However, the paper lacks fair comparison with CAST and does not fully prove that cross-video transition transfer causes the gains.
Critical strengths
- The authors address an interesting problem in video retrieval, learning transferable transitions across different visual contexts makes sense for procedural videos. The motivation is clear and the method has some novelty.
2.The authors provide quite detailed ablation studies. The swap objective improves accuracy by 2.39 and 3.86 percentage points on YouCook2 and CrossTask over the factorized base. The results across three seeds make the improvements more convincing.
3.The authors test compatible, random, wrong, and reversed transitions. The method also needs no donor videos during inference, which is practical.
Critical weaknesses
1 The authors do not rerun CAST under their reconstructed evaluation protocol. They report published CAST results from different candidate pools, so these numbers cannot support a direct comparison. The paper needs a fair experiment to show whether SwapCAST actually outperforms CAST.
-
The authors do not compare their factorized architecture with a non-factorized residual prediction model. Their main ablations only compare different training objectives within the same architecture. It is unclear whether seperating persistent context and transition codes is actually necessary.
-
The authors combine transition recomposition and donor-endpoint discrimination in their main swap ablation. Although they test removing donor discrimination, they do not add equivalent hard-negative supervision to the base model without swapping.
-
The authors only evaluate on YouCook2 and CrossTask. Each retrieval query contains only ten candidates, which is quite limited for testing retrieval performance. The paper lacks larger candidate pools, unseen task evaluations, and cross-dataset generalization experiments.
5 The observed transition encoder takes both source and target visual embeddings, which allows the transition code to retain donor-specific appearance and context information. The relational losses and donor negatives do not explicitly remove this information, so the claimed separation between persistent context and transition is not so guaranteed.
Questions for authors
Address the weaknesses.