- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies what aggregate accuracies reveal about AV-model adaptation. Coverage measures correctness in at least one unimodal run. Conversion is joint accuracy minus coverage. Overlap bounds identify possible conversion changes.
Critical strengths
- Classical probability bounds become a practical reporting rule. One additional overlap-change statistic resolves the ambiguity.
Critical weaknesses
- Coverage and the bounds build on established ideas, limiting theoretical novelty.
- How this analysis can guide practical training or inference to improve performance remains unclear.
Questions for authors
-
When some questions in the test set require only one modality to answer, is conversion still useful for understanding the model ability?
-
How can this analysis guide training or inference to improve performance? Can you demonstrate gains under matched compute budgets on an independent test set?
Thank you for your responses to my questions.