- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SeeTheFlow, a training-free framework for flowchart parsing that combines CV/OCR derived structural priors with VLM inference. It introduces an adaptive SVM router to selectively apply structural guidance and an optional verification mechanism to refine predicted graphs. The authors also construct a benchmark of 1,200 flowcharts with varying structural complexity. Experiments show improvements in CW-F1, particularly on large and complex flowcharts, while reducing unnecessary VLM inference calls.
Critical strengths
- Addresses the challenge of recovering node connectivity and control-flow structures in complex flowcharts.
- Proposes a training-free framework combining CV/OCR derived structural priors with adaptive routing to reduce unnecessary VLM calls.
- Introduces a benchmark of 1,200 flowcharts with controlled structural complexity.
Critical weaknesses
- Table 1 only reports relative improvements without absolute baseline scores, making it difficult to assess performance degradation as diagram complexity increases.
- The effectiveness of the method varies substantially across VLMs. While Gemini-3.5 achieves a 22.8 pp improvement in CW-F1, Llama-4 and Qwen-3.5 experience drops of 14.0 and 7.8 pp, respectively. The proposed router is model-independent and cannot account for these differences. Moreover, the paper lacks a detailed analysis of why structural guidance degrades performance for certain models.
- Several inconsistencies appear in the reported results, including intervention rates in Figure 4, error proportions in Figure 3, and average VLM call counts in Table 1.
Questions for authors
- Table 1 reports only the CW-F1 improvements over the baseline, without providing the absolute baseline scores for the pooled and large subsets. Given the paper's central claim that image-only VLM performance degrades with increasing diagram complexity, could the authors report the absolute CW-F1 scores for both the baseline and SeeTheFlow across different diagram sizes? This would help clarify the extent of performance degradation and how effectively SeeTheFlow mitigates it.
- Figure 4 reports an intervention rate of 8% for small diagrams, whereas both its caption and the main text in Sections 6 and 7 report 4%. Could the authors clarify which value is correct and explain the discrepancy? Were the figure and the reported statistics generated from the same evaluation runs?
- In Figure 3 (right), the proportion of missing connections remains at 37% for both Baseline and SeeTheFlow (13.9 → 11.2 errors per diagram), whereas Section 6 states that this proportion decreases from 36.3% to 28.3%. Similarly, the proportions of extra connections reported in the figure (8% → 14%) differ from those in the text (19.5% → 30.3%). Could the authors clarify whether these statistics are computed using different evaluation subsets or definitions, and explain these discrepancies?