- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies aspect-ratio-adaptive flowchart relayout: transforming an existing raster diagram to a target canvas while preserving its content, connectivity, and visual style, and producing editable draw.io XML. The proposed pipeline separates parsing, style reconstruction, and layout adaptation, with stage-specific critics combining deterministic checks and visual feedback. The authors introduce FlowchartRelayoutBench, consisting of 100 source diagrams evaluated at five target aspect ratios. The method achieves 68.6% Content Fidelity compared with 41.4% for the strongest evaluated baseline. Ablations and a human evaluation further support the usefulness of the decomposition and iterative refinement.
Critical strengths
-
The paper addresses a practical problem: adapting scientific flowcharts to different canvases while preserving their meaning. Editable draw.io output further increases its usefulness by supporting subsequent manual refinement.
-
The Parse–Style–Layout decomposition is well motivated and substantially improves Content Fidelity over the evaluated baselines. Ablations and human evaluation provide supporting evidence for the effectiveness of iterative refinement.
Critical weaknesses
-
The benchmark contains only 100 source diagrams, with 500 tasks obtained by evaluating each diagram at five aspect ratios; these tasks should not be treated as 500 independent samples. The ablations use just 30 diagrams. This limits confidence in the robustness and generalizability of the reported gains, particularly the smaller differences between ablation variants.
-
For a benchmark contribution, the coverage of evaluated methods remains limited. Although Table 7 includes Qwen-based experiments, broader comparisons with open-weight code-generation models and general-purpose agent harnesses such as Codex, using comparable tools and inference budgets, are needed to better establish the proposed pipeline’s advantage.
Questions for authors
-
How were the 30 ablation diagrams selected, and which target aspect ratios were evaluated? Could you expand the ablations and report confidence intervals that account for tasks sharing the same source diagram, together with repeated-run variability, to establish whether the observed differences are stable?
-
Could you evaluate additional open-weight code-generation models and general-purpose agent harnesses with rendering and iterative revision under comparable budgets? Please also clarify the subset, aspect-ratio coverage, and refinement opportunities used in the existing Qwen experiments.
6 comments
Response to Reviewer Ta7F (Part 2/3)
(Continued from Part 1: W1, and W2/Q2—Open-Weight Code-Generation Models.)
-
General-Purpose Agent Harnesses
We further compare our method with general-purpose agent harnesses, using Codex as a representative, on the same 30 flowcharts from the ablation subset, alongside one-shot Gemini 3.1 Pro and one-shot GPT-5.5. Codex uses gpt-6.1-sol with reasoning effort set to medium and has access to
exec_command,view_image,apply_patch, andwrite_stdinfor image inspection, code execution, and XML editing. It can also invoke the draw.io Desktop CLI to render the results. A single Codex agent processes all 30 flowcharts in one conversation. The entire batch takes approximately 10.52 minutes, including image inspection, code development, and tool execution, and uses a total of 2,991,501 tokens. Both the runtime and token usage are totals for the full batch. The three baselines use the same task prompt, shown below.You are a visual layout transformation agent specializing in flowchart relayout. Task: Read the input flowchart image and rearrange it to fit the target canvas dimensions (canvasWidth and canvasHeight). Preserve its nodes, shapes, text, connectivity, arrow directions, branching relationships, and visual style. Preserve the original reading order, groups, hierarchy, parallel flows, and important relative positions where possible, while adapting the layout to the target aspect ratio. Output: Return only a complete, editable draw.io mxfile XML document. Represent nodes as editable vertices and connections as editable edges. Set pageWidth and pageHeight to the specified canvas dimensions. Do not include Markdown or explanatory text. [Detailed XML format requirements omitted here for brevity.]Method Rel.↑ Hallu.-free↑ Content↑ Layout↓ Style↓ Overall↑ Ours 76.7 96.7 76.7 1.57 1.27 92.78 One-shot Gemini 3.1 Pro 43.3 50.0 33.3 3.57 2.67 35.56 One-shot GPT-5.5 33.3 80.0 30.0 3.27 2.50 36.67 Codex (GPT-6.1 Sol, Medium) 46.7 56.7 30.0 2.53 3.57 35.00 Note: The Layout and Style ranks are computed only among the four methods in this table, so these two metrics, and the Overall score that depends on them, cannot be directly compared with the values in Table 4 of the paper.
The results show that the Content Fidelity of our method is 76.7%, higher than the 30.0% of Codex and the 30.0% and 33.3% of the two one-shot baselines, which shows that our method preserves the structure and content of the flowchart more completely. From the outputs, Codex is better at cropping and embedding the images in the original diagram, and compared with the two one-shot baselines, fewer cases of images being regenerated or failing to embed occur. However, its nodes and connectors tend to adopt a uniform, template-like style, for example light fill colors, rounded nodes, and solid arrows with rounded bends, so it preserves the individual styles of the original diagram to a limited extent; its average Style Similarity rank is 3.57, behind the other three methods. The three baselines also often produce crossing or overlapping connectors, or connectors passing through nodes; their average Layout Quality rank ranges from 2.53 to 3.57, all behind the 1.57 of our method. The Overall score of our method reaches 92.78, also higher than the 35.00 to 36.67 of the three baselines.
(Continued in Part 3: Q1.)
Response to Reviewer Ta7F (Part 3/3)
(Continued from Part 2: W2/Q2—General-Purpose Agent Harnesses.)
Q1: Ablation Design and Statistical Reliability
-
Subset Selection and Aspect-Ratio Coverage
The 30 flowcharts used in the ablation study are selected by structural complexity, with 10 diagrams from each difficulty level (easy, medium, and hard), so that every difficulty level has equal weight in the evaluation, in order to fairly compare the contribution of each module across different structural complexities. Each diagram is evaluated at one target aspect ratio, covering 1:1, 2:3, 3:2, 9:16, and 16:9, with 7, 6, 8, 4, and 5 diagrams, respectively, so as to cover square, portrait, and landscape canvases.
-
Repeated-Run Variability and Statistical Robustness
To test whether our results depend on a single generation or a single evaluation, we conduct two kinds of repeated experiments on the same 30 ablation flowcharts. Each source diagram in this ablation subset corresponds to only one target aspect-ratio task, so there is no dependence arising from multiple tasks derived from the same source diagram. Each experiment is repeated three times; below we report the mean ± standard deviation, together with 95% confidence intervals computed with the t distribution (df = 2). These intervals reflect the run-to-run variability on a fixed subset and do not cover the uncertainty from data sampling.
First, we fix the generated outputs of all 10 settings and re-evaluate them independently three times with the VLM-as-a-Judge, to measure the variability of the evaluation itself.
Variant Overall Score 95% CI Content Fidelity 95% CI Ours 84.8 ± 1.6 [80.8, 88.8] 70.0 ± 0.0 [70.0, 70.0] w/o All Critic Agents 47.7 ± 2.4 [41.7, 53.6] 50.0 ± 5.8 [35.7, 64.3] w/o Parse Critic 58.9 ± 2.3 [53.3, 64.5] 51.1 ± 5.1 [38.5, 63.8] w/o Layout Critic 56.4 ± 3.3 [48.1, 64.7] 54.4 ± 1.9 [49.7, 59.2] w/o Style Stage 74.7 ± 2.4 [68.8, 80.6] 68.9 ± 3.8 [59.3, 78.5] Direct Prompt VLM-to-XML (Gemini 3.1 Pro) 34.7 ± 2.1 [29.5, 39.9] 35.6 ± 3.8 [26.0, 45.1] Direct Prompt Layout Stage 65.4 ± 3.0 [58.0, 72.9] 61.1 ± 3.8 [51.5, 70.7] Direct Prompt VLM-to-XML (GPT-5.5) 34.3 ± 4.4 [23.3, 45.4] 23.3 ± 5.8 [9.0, 37.7] Direct Prompt Parse Stage 46.8 ± 4.1 [36.7, 56.9] 41.1 ± 10.2 [15.8, 66.4] w/ Graphviz (DOT) Layout 11.1 ± 0.6 [9.5, 12.7] 13.3 ± 0.0 [13.3, 13.3] The results show that the standard deviation of the Overall Score over the three repeated evaluations ranges from 0.6 to 4.4, and our method still has the highest mean score, indicating that the overall scoring variability of the evaluation is small and that the main ablation conclusions remain supported under repeated evaluation.
In addition, for our method only, we regenerate three times with the full pipeline and feed each generated output separately into the evaluation, to measure the combined variability of generation and evaluation. The table below places this result alongside the re-scoring result on the fixed outputs above.
Experiment Overall Score 95% CI Content Fidelity 95% CI Ours — Re-scoring 84.8 ± 1.6 [80.8, 88.8] 70.0 ± 0.0 [70.0, 70.0] Ours — Re-generation and Evaluation 83.8 ± 3.4 [75.4, 92.2] 67.8 ± 1.9 [63.0, 72.6] The results show that after regeneration and evaluation, the standard deviation of the Overall Score of our method is 3.4 and that of Content Fidelity is 1.9 percentage points, and the mean performance is close to that of re-scoring the fixed outputs. Even when the variability of both generation and evaluation is included, the results still fluctuate relatively little, supporting the repeatability of our method's performance on the current subset.
Response to Reviewer Ta7F (Part 1/3)
Thank you for recognizing the practical value of editable flowchart relayout and our Parse–Style–Layout design. We address benchmark scale and generalizability, model coverage, and ablation reliability below.
W1: Benchmark Size and Generalizability
Our dataset and generalization coverage leave room for expansion, but our evaluation scale is comparable to recent work. AutoFigure-Edit [1] uses 200 method descriptions, of which 100 each are under the settings with and without a style reference; SlideTailor [2] uses 50 target papers for its main experiments; Paper2Poster [3] is evaluated on a benchmark of 100 paper–author-made poster pairs. For the Parse and Style stages, our evaluation covers 100 distinct source flowcharts; for the Layout stage, we set five target aspect ratios for each diagram, forming 500 relayout tasks with different canvas constraints to test the ability to adapt across ratios. We agree that tasks derived from the same source are dependent, so the number of distinct source diagrams remains 100. At this scale, Table 2 still shows advantages in structure/content preservation and Overall score, while Table 4 supports each module’s contribution.
Our ablation scale is also comparable: SlideTailor [2] randomly selects 30 cases for its quantitative ablation to analyze the contribution of each module. We likewise use 30 flowcharts, selecting 10 each from the three structural complexity levels (easy, medium, and hard), so that every difficulty level has equal weight in the evaluation, in order to quantify the impact of the different modules on the relayout results.
[1] Z. Lin et al., “AutoFigure-Edit: Generating Editable Scientific Illustrations via Reference-Guided Styling,” ACL System Demonstrations, pp. 57–67, 2026.
[2] W. Zeng et al., “SlideTailor: Personalized Presentation Slide Generation for Scientific Papers,” AAAI, 40(41), pp. 34584–34592, 2026.
[3] W. Pang et al., “Paper2Poster: Towards Multimodal Poster Automation from Scientific Papers,” NeurIPS 38, 2025.
W2 & Q2: Additional Comparisons with General-Purpose Agent Harnesses and Open-Weight Code-Generation Models
Open-Weight Code-Generation Models
Thank you for suggesting broader comparisons with open-weight models. In addition to the existing Qwen3.6-27B experiments, we evaluate GLM-5.3-flash to examine the applicability of our pipeline across models. Both models are evaluated on the same subset of 25 flowcharts, comprising 15 Easy, 7 Medium, and 3 Hard cases. This subset emphasizes easy cases while also covering medium and hard cases. Each flowchart is evaluated at one target aspect ratio, with five cases each for 1:1, 2:3, 3:2, 9:16, and 16:9. We compare one-shot direct XML generation with our three-stage pipeline. Both Qwen and GLM use the same iteration limits as our method, with a maximum of 3, 2, and 5 iterations for the Parse Stage, Style Stage, and Layout Stage, respectively. Rendered outputs and Critic feedback guide refinement until the output passes the checks or reaches the iteration limit.
Using the same GLM model, direct XML generation is more prone to missing connections and failing to faithfully preserve complex shapes and images. Through iterative checking and refinement, our method improves Relationship Preservation from 52.0% to 60.0%, Hallucination-free Rate from 44.0% to 72.0%, and Content Fidelity from 20.0% to 40.0%. Direct generation also more frequently produces inconsistent flow directions, excessive spacing between components, content concentrated on one side, and node or background colors that differ from the source figure. Our method mitigates these issues, improving the average Layout and Style ranks from 1.64 to 1.28 and 1.36, respectively.
The additional GLM experiments demonstrate that our method can also achieve effective content preservation and aspect-ratio adaptation with an open-weight model. Compared with the full pipeline using Qwen3.6-27B in Table 7, using GLM improves Relationship Preservation from 20.0% to 60.0% and Content Fidelity from 20.0% to 40.0%. Inspection of the outputs shows that Qwen produces better layouts primarily on 1:1 canvases, whereas GLM preserves content more completely and produces reasonable layouts across different target aspect ratios. These results indicate that the lower performance previously observed with Qwen does not represent a general limitation of our method on open-weight models, further supporting its applicability across different open-weight models.
(Continued in Part 2: W2/Q2—General-Purpose Agent Harnesses.)