- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates rubric-induced confabulation in vision-language models (VLMs) applied to procedural skill assessment. The authors argue that providing detailed assessment rubrics can cause VLMs to report procedural actions that are not actually observed in the video.
The study introduces four input conditions (zero, weak, strong, and leak) to investigate the influence of rubric information and visual evidence. It further proposes white-box counterfactual measurements based on token log-probabilities and a black-box trust score based on repeated claim generation.
Experiments cover nine VLMs and 874 video clips across four domains. The results suggest that detailed rubrics improve the coverage of procedural steps but also increase unsupported claims. The proposed auditing method shows promising performance in identifying visually grounded claims.
Critical strengths
- Important and practically relevant problem.
The paper investigates a meaningful limitation of VLMs in educational and vocational assessment. The finding that detailed rubrics can improve procedural coverage while simultaneously increasing unsupported claims is interesting and potentially relevant to reliable multimodal AI systems.
- Counterfactual experimental design.
The strong, weak, zero, and leak conditions provide a useful framework for investigating the relative influence of task information and visual evidence. In particular, replacing the original video while retaining the same rubric is an interesting approach to identifying claims driven by textual rather than visual information.
- Broad empirical evaluation.
The evaluation includes nine VLMs across four domains, covering both open-weight and closed-source models. The authors also provide human validation of the claim-extraction pipeline, reporting an F1 score of 0.942. These efforts strengthen the empirical contribution.
Critical weaknesses
- Limited connection between the proposed evaluation and actual procedural skill assessment.
Although the paper is motivated by human procedural skill assessment, the actual evaluation primarily concerns the factual accuracy of VLM-generated procedural descriptions.
The pipeline generates captions and structured action descriptions from video inputs, extracts rubric-related claims using LLM judges, and compares those claims against binary action-occurrence labels.
This does not directly evaluate whether a learner performed an action correctly, the quality of execution, or the reliability of final skill assessment scores.
I recognize that claim-level factual grounding is a meaningful intermediate problem. Nevertheless, the paper should more clearly distinguish the proposed auditing task from comprehensive procedural skill assessment. Additional evidence connecting the auditing method to downstream assessment quality would strengthen its practical claims.
- Insufficient methodological detail and reliability analysis for ground-truth annotations.
The reported false-claim rates and coverage depend critically on the reliability of the ground-truth action-occurrence labels.
Appendix A.3 reports raw inter-annotator agreement ranging from 87.4% to 94.6%, but several details remain unclear, including the number and qualifications of annotators, the independent annotation procedure, the handling of temporal boundaries, and the adjudication process.
Given the substantial imbalance between occurred and absent steps, raw agreement alone may not adequately characterize annotation reliability. Chance-corrected agreement and positive-class agreement would provide useful complementary evidence.
Additionally, the Kitchen domain uses video-level annotations propagated to individual 60-second clips. As acknowledged by the authors, this may underestimate false-claim rates and overestimate coverage. The potential impact of this approximation on the reported findings deserves further investigation.
- Dependence on a single LLM backbone for claim extraction.
All three judging roles (lenient, strict, and reverse) use the same gpt-oss-120b model. Although different prompting strategies are employed, the judges are not independent model families.
The human validation results are encouraging. However, the robustness of the main conclusions to the choice of judge model remains unclear.
Different LLM judges may interpret ambiguous procedural descriptions differently, affecting extracted claims, assertion frequencies, false-claim rates, and the proposed trust-score rankings.
A sensitivity analysis using at least one alternative judge-model family would help establish whether the findings are specific to gpt-oss-120b or generalize across evaluation models.
- Insufficient justification of the number of repeated generations.
The black-box method relies on only five generated captions per input condition. As a result, claim-frequency estimates have a resolution of 0.2.
Moreover, the sampling protocol combines one generation at temperature 0 with four generations at temperature 0.5 when supported. Consequently, these observations do not necessarily represent identically distributed samples from a single decoding configuration.
While this approach is computationally understandable, the paper does not sufficiently establish whether five generations are adequate for stable trust-score rankings.
This concern is particularly relevant because some improvements over individual-input baselines are relatively modest, and the proposed method does not outperform the strongest single-input baseline in every model-domain combination.
A sensitivity analysis with larger sample sizes, such as N = 10 or N = 20, would help establish the robustness of the reported ranking performance.
- Potential sensitivity to video preprocessing and counterfactual video selection.
The video-processing procedures differ across model families. For example, GPT models receive only 20 uniformly sampled frames per 60-second clip, whereas other models use their respective video-processing interfaces.
Short procedural actions may be missed by sparse frame sampling, potentially affecting whether a model can visually verify an action.
I acknowledge that the authors appropriately focus their counterfactual comparisons within each model. Nevertheless, the effective visual information available to each model should be characterized more explicitly.
Furthermore, the leak condition uses an unrelated real video as the counterfactual visual input. It remains unclear whether the resulting differences reflect evidence for specific procedural steps or broader semantic compatibility between the video and the rubric.
A within-domain video-replacement analysis, or a sensitivity analysis involving alternative replacement videos, would strengthen the interpretation of visual grounding.
Questions for authors
-
Can the authors provide additional details about the human annotation protocol, including the number of annotators, annotation independence, temporal-boundary rules, and chance-corrected agreement statistics?
-
How robust are the claim-extraction results and downstream trust-score performance to the choice of LLM judge? Have alternative judge models or single-judge configurations been evaluated?
-
Why was N = 5 selected for repeated generation? How do average precision and claim rankings change when larger numbers of samples are used?
-
How sensitive are the results to the effective frame-sampling rate and the selection of counterfactual replacement videos?
-
To what extent can the proposed auditing method improve downstream procedural skill assessment, beyond detecting unsupported claims in generated descriptions?