- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper extends existing video captioning datasets by segmenting videos at varying granularities and controlling caption length, and constructs corresponding embedding modules to enable controllable generation in video captioning models.
Critical strengths
The structure of this paper is quite comprehensive, and the experiments are highly thorough.
Critical weaknesses
- The paper emphasizes that density and depth can be provided as continuous inputs; however, in practice, both the dataset annotation and the model training process only utilize three discrete values: 0, 0.5, and 1.
- The paper claims that the model can adapt to unseen intermediate inputs. However, in Table 4, one dimension is always fixed at 0.5, and the authors do not evaluate experimental settings where both density and depth are simultaneously unseen (e.g., a (0.25, 0.25) configuration). Furthermore, the choice of 0.25 and 0.75 is rather coarse. While an embedding-based model should inherently possess basic interpolation capabilities, the experiments fail to explore the actual boundaries or limits of this capability.
- Current evaluation metrics (e.g., CIDEr, METEOR) are highly sensitive to synonym substitution and length inflation, rendering them incapable of distinguishing between "meaningful detail enrichment" and "meaningless filler text" (or semantic bloating).
- if the model predicts "chopping onions" at a control value of 0.25, but outputs "heating oil" and "adding salt" at 0.5 (completely omitting the onion chopping), such "controllability" would be confusing and practically meaningless to the user, even if the total event count increases from 1 to 2. Consequently, the paper currently lacks a quantitative evaluation of the "Semantic Containment Rate" to verify hierarchical consistency across such cross-granularity predictions.
Questions for authors
Table 2 in the paper indicates that MLLM-based DVC methods perform poorly, but this comparison appears to be made against task-specific models under a "fixed granularity" setting. What would be the outcome if a powerful MLLM (e.g., GPT or Gemini) were directly prompted to explicitly generate descriptions at "low/mid/high" density levels, and these outputs were then compared against the generation results of UC-DVC?