- Rating
- 2
- Confidence
- 4(+1)
- Informativeness
- 3(+1)
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FigAct turns questions about scientific figures into visual presentations through a Plan–Ground–Act pipeline. It combines hierarchical SVG search with a deterministic renderer and trains FigAct-8B through SFT and RL. The paper evaluates the framework on 400 real-world question–figure pairs and in a user study.
Critical strengths
Linking narration directly to elements in the original figure can reduce the effort readers spend mapping text back to visual evidence. The framework improves grounding and action execution across several backbones. The appendix provides implementation details, ablations, and failure cases, giving the work practical and research value.
Critical weaknesses
- The evaluation does not sufficiently distinguish successful presentation generation from improved understanding.
Comp. and Exec. approach saturation after adding the framework, but mainly measure output completeness and executability. Video–narration similarity and model-based presentation scores also provide limited evidence that added annotations or inferred relationships are scientifically correct. The user study offers encouraging evidence, but it is unclear whether conditions use identical narration and comparable viewing time. Uncertainty accounting for participant and question differences is also missing. It is therefore difficult to attribute the improvement in comprehension specifically to visual actions.
- The independent benefits of hierarchical search and training remain unclear, and some reported results are inconsistent.
The framework changes SVG grouping, visual inputs, search, and action execution together. The dual-view ablation is useful, but a comparison between flat selection and hierarchical search under the same grouped representation, views, and budget is still needed. The reported 40–50× reduction concerns SVG tokens; the total cost of visual inputs, model calls, and rendering remains unclear. FigAct-8B improves substantially over its own baseline, but its grounding F1 and Pres-Q remain below Claude Fable 5.1 and GPT-6 Astra when both use FigAct. The paper should establish the smaller model’s quality–cost trade-off more clearly. In particular, RL raises grounding F1 from 52.67 to 62.27 while reducing Pres-Q from 82.47 to 82.16, leaving its benefit to final presentation quality uncertain. The appendix explains that SFT search trajectories are reconstructed from known final targets, but the supplementary package does not provide inspectable training trajectories or run records. More evidence is needed on how this ideal-path supervision transfers to actual search and whether RL adds value beyond an additional SFT budget. The numerical inconsistencies also matter: SFT grounding F1 is 52.67 in the main table but 60.67 in Table 8, while SFT Pres-Q is 82.47 in the main table but 80.56 in Table 6.
Questions for authors
- Does the user study control narration content and viewing time? How large is the benefit of visual actions after accounting for participant and question differences?
- What does “reference propagation” mean? Do downstream stages receive predictions or reference annotations, and which results evaluate the complete predicted pipeline?
- Under matched representations and budgets, what are the separate gains from hierarchical search and RL? What is FigAct-8B’s quality–cost trade-off relative to the stronger models?
- Can you provide training trajectories and run records and reconcile the inconsistent SFT results across tables?
I see value in the task and practical promise in the framework, but the evidence for comprehension gains, component contributions, and training benefits is not yet sufficient. I would consider raising my score if the authors clarify the evaluation protocol, reconcile the reported results, and provide targeted evidence for the independent benefits of visual actions and training.
Response for Reviewer bjif (Part 1/5)
We thank the reviewer for the thoughtful review and for recognizing the task formulation, supervision design, and ablation coverage. Below, we provide additional baseline comparisons and efficiency reporting.
Q1: Baseline fairness and Missing intermediate baselines
Your Concern: Gains over non-FigAct baselines may partly reflect context overflow. Intermediate baselines are needed to distinguish the contributions of grouping and hierarchical search.
Our Response: We extend the view ablation in Appendix E.1 (Table 5) with additional intermediate baselines to disentangle the contributions of grouping, hierarchical search, and candidate visualization.
2.08and5.28points for Gemini 3.5 Flash and Qwen3-VL-8B, respectively.7.01and6.82points for Gemini 3.5 Flash and Qwen3-VL-8B, respectively.