- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2(+1)
Read review
Paper summary
In the task of monocular food volume estimation, this paper uncovers a critical flaw in existing benchmarks: they conflate a model's geometric measurement capability with the contribution of simple category recognition. Furthermore, the authors demonstrate that the performance gains from popular VLM-fusion approaches do not actually arise from sophisticated visual reasoning by the VLM, but merely from pulling extreme overestimations by the geometric model back toward a common-sense scale. The paper also validates that accuracy can be improved by taking the class median as a reference and leveraging the geometric model solely to extract and calibrate within-class individual variations. Overall, these findings suggest that to measure the true contribution of geometric models, an "image-blind class average" must serve as a mandatory baseline, and that a rigorous evaluation protocol is necessary to rule out superficial improvements from naive VLM fusion.
Critical strengths
As multimodal fusion has become increasingly mainstream, uncovering the critical flaws and confounding factors in existing evaluation datasets is a timely and valuable contribution. It seems also impactful to demonstrate that VLM-fusion methods do not achieve genuine visual reasoning, but merely act as coarse scale regularizers that pull extreme geometric overestimations back toward common-sense priors.
Critical weaknesses
The manuscript suffers from poor writing and an overwhelming information density, requiring unreasonable effort from the reader to digest. Domain-specific acronyms such as NOCS, MADIMA, and ECUSTFD appear without any explanation or definition, disregarding readers outside this specific subfield. Figures and tables are frequently unreferenced or cited out of order, and the text leans far too heavily on a massive appendix that hardly feels manageable for a human reader. While the empirical results appear very important, the presentation fails to communicate them effectively, and a major overhaul of the manuscript's presentation is necessary.
Questions for authors
What do the authors consider to be the most essential contribution of this work? Currently, both the Abstract and the Introduction read like an enumeration of specific empirical results, making it difficult to grasp the overarching takeaway and fundamental implications for researchers in this field. I would like the authors to clearly articulate their perspective on this.