- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces Surface-Tension Regularization (STR), an auxiliary objective that separates multimodal embedding pressures into agreement, separation, and diversity terms. Its main purpose is to audit embedding geometry rather than to substantially improve retrieval scores. Using video–text retrieval models, the authors compare a baseline with STR and measure how retrieval changes when a proposed shared direction is removed, the remaining vectors are rescaled, or both operations are applied. They report different responses to these interventions despite similar final retrieval scores. The main experiments cover four benchmarks with three seeds each; the paper also tests an alternative attraction term and reports factorial and gradient analyses.
Critical strengths
- The paper provides a careful audit of multimodal embedding geometry. It separates shared-direction deletion from residual-norm rescaling and reports how each operation affects retrieval. Random-direction, SVD1, and per-query controls make the central observation easier to assess.
- The main diagnostic results are supported by repeated experiments. The baseline–STR comparison covers four video-text retrieval datasets with three seeds each. The paper also tests alternative regularization terms and additional backbones, and clearly acknowledges that the final retrieval gains are small and the full geometric pattern does not transfer to every backbone.
Critical weaknesses
-
The paper’s main removal result appears sensitive to how the direction is defined. In the baseline, the text and video centroids are nearly orthogonal, so their sum is not clearly a shared direction. At MSR-VTT seed 0, removing SVD1 changes R1 from 41.0 to 45.4 for the baseline and from 39.5 to 40.4 for STR (Table 15), reversing the sign of the between-model response difference. The paper should test whether the result holds under other direction definitions across datasets and seeds.
-
The scope of the paper’s conclusion is unclear. The full pattern is observed with VAST under ITC+ITM finetuning, but none of the additional backbones reproduces it in full (Table 7). Although the paper compares final retrieval scores with GRAM, Symile, and TRIANGLE, it does not apply the geometric audit to those models. The evidence therefore does not establish whether the finding extends beyond this particular training setup.
-
The paper does not demonstrate a consistent retrieval gain from STR. Its final text-to-video R1 differs from the baseline by only −0.1 to +0.4 points across the four datasets (Table 1), while its unmodified text–video embedding R1 is lower on all four (Table 14). Video-to-text R1 also falls on three datasets (Table 25). These results leave the practical value of the changed geometry unclear.
-
The evidence for the paper’s three-term interpretation is limited. At the default setting, has very little effective pressure, and already produces much of the reported geometry. The factorial and gradient-cosine analyses use only seed 0, and the additional-backbone results are single runs. The smaller component effects are difficult to assess without estimates of their variability.
Questions for authors
-
How is the sum of the text and video centroids justified as a shared direction when the two centroids are nearly orthogonal in the baseline? Does the main removal result hold under other direction definitions, including SVD1, across datasets and seeds?
-
Does the full geometric pattern appear in any of the additional backbones under comparable training conditions? Can the same geometric audit be applied to GRAM, Symile, and TRIANGLE to clarify how broadly the conclusion applies?
-
Given the small and inconsistent changes in final retrieval scores, what practical benefit does STR provide? How should the lower unmodified embedding R1 on all four datasets be interpreted?
-
What is the effective contribution of at the default setting beyond ? Can variability across seeds be reported for the factorial, gradient-cosine, and additional-backbone analyses?