- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces ChartDensity-Bench, a benchmark for reconstructing chart tables from compound scientific figures. It evaluates models on figures containing 1, 3, 6, or 9 charts and measures structural recovery, completeness, parseability, and numerical accuracy. The main finding is that reconstruction usually becomes worse as more charts are shown together.
Critical strengths
1.The paired setup evaluates the same source chart under different visual contexts, making the density effect easier to study than in ordinary benchmark comparisons.
2.The evaluation separates chart-level failures, missing points, and numerical errors, which gives a more useful diagnosis than a single chart-to-table score.
Critical weaknesses
1.The practical significance of the task is unclear. Chart-to-table extraction is well studied, and compound figures can often be cropped into individual charts before extraction. Without comparing against a crop-then-extract pipeline, it is unclear whether the reported degradation reflects an important limitation or an avoidable preprocessing issue.
2.The density effect is not cleanly isolated. Increasing the number of charts also changes each chart’s effective resolution and may trigger different image preprocessing across models. In addition, numerical errors are computed only on successfully matched points, which may make the results sensitive to the matching procedure.
Questions for authors
1.Why should a model process the full compound figure instead of first detecting and cropping individual subplots? How much does the crop-then-extract baseline improve performance?
2.Does the density effect remain when per-chart resolution and overall input size are controlled? How are missing, duplicated, or unmatched points penalized in the numerical metrics?