- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies Text-to-SVG generation and argues that semantic component organization (planning) and geometric realization (drawing) are distinct capabilities that interfere under joint optimization. The authors first build SVGVerse, a 196,757-sample SVG dataset in which visually coherent elements are reorganized into explicit semantic groups via multi-LLM reconstruction filtered by a fine-tuned VLM evaluator and human review. They then propose DEFT: (i) two-stage SFT establishing correspondences among text, semantic components, and drawing commands; (ii) independent GRPO optimization of a Planning Expert (format × (recall + Jaccard + order) reward) and a Drawing Expert (format × (DreamSim + LPIPS) reward) from the shared SFT initialization; and (iii) Command-Routed On-Policy Distillation that integrates the two experts into a single model, applying forward KL on planning commands (<g>, <title>, <desc>) and reverse KL on drawing commands (<path>, <rect>, <circle>, <polygon>). Experiments on SVGVerse, SArena, and MMSVG-Bench show competitive or best results among 8B-scale and larger baselines, and ablations validate command routing, the planning→drawing distillation order, and the asymmetric KL design. The claimed conclusion is that separating and re-integrating planning and drawing yields both better semantic organization and better visual quality.
Critical strengths
- Well-motivated framework with direct evidence for the motivating premise: Table 6 shows joint multi-reward RL underperforms each specialized expert on its own axis, justifying the separate-then-integrate design rather than asserting it (Sec. 1, Sec. 5.4).
- SVGVerse is a substantive data contribution: 196k semantically grouped SVGs with a three-stage quality pipeline (multi-model reconstruction, VLM evaluator, human verification; Sec. 3, Fig. 1). If released, it has independent value to the community.
- Command-routed OPD is a concrete and well-ablated instantiation: token-level routing by the semantic role of SVG commands, plus the FKL-for-planning / RKL-for-drawing asymmetry, each supported by dedicated ablations (Table 5).
- Broad evaluation: three evaluation settings, 20+ baselines spanning optimization-based methods, general VLMs, proprietary models, and specialized SVG-LLMs (Tables 2–4). DEFT is best on all four SVGVerse drawing metrics and on all three SArena-Illustration metrics at 8B scale.
- The analysis section (Sec. 5.4) is denser than typical for this subfield, including reward-interference analysis (Table 6) and per-component reward ablations (Table 7).
Critical weaknesses
- The method is essentially an application of MOPD (Ma et al., 2026) to Text-to-SVG. MOPD which is listed in the paper's own bibliography but never discussed in the main text, proposes the same skeleton: specialized per-domain RL experts trained from a shared SFT initialization and integrated into a single student via on-policy distillation on the student's own rollouts. DEFT's deltas are (i) token-level routing by the semantic role of SVG commands instead of prompt-level routing, (ii) a two-stage sequential distillation with asymmetric KL objectives, and (iii) the SVG instantiation with specialized rewards and the SVGVerse dataset. These are competent, well-ablated engineering adaptations, but they amount to transferring an existing post-training framework to a new modality rather than contributing a new method. Command routing and the FKL/RKL choice are local design decisions, not a new methodological principle. A rebuttal showing DEFT beats an MOPD-style baseline would demonstrate good adaptation, not new methodology.
- The related work is placed in the supplementary material, so the main text is not self-contained. Related work is precisely where the novelty positioning belongs; moving it out of the main text means readers cannot assess the increment over the closest works (MOPD, SVGBuider) from the paper itself. Consequently, roughly ten bibliography entries (DeepSVG, ClipDraw, CLIPasso, SVGBuider, SVGenius, SVGEditBench v1/v2, FIGR, PPO, MOPD) are never cited in the main text. Whatever the motivation (e.g., page pressure), this is a structural compliance issue and has the practical effect of avoiding a head-on comparison with the most related method.
- In-domain evaluation is partly circular: SVGVerse test references are themselves LLM reconstructions, and planning metrics (F1/LCS) are computed against the reconstruction pipeline's own component sequences, on which the model is trained. No human evaluation anchors these proxies to actual human judgments of semantic organization or editability — the very motivation of the paper (Abstract).
- Reproducibility: no code/data release statement; GRPO hyperparameters, reward shaping details (sigmoid parameters, BERT model), and compute are absent from the main text (deferred to appendices).
- The abstract's blanket superiority claim is contradicted in places by the paper's own tables (SArena-Icon FID 10.723 vs. InternSVG 8.715; MMSVG-Illustration HPS 0.235 vs. Chat2SVG 0.250; Aesthetic 4.64 vs. VectorFusion 4.94). The more careful claims in Sec. 5.2 are the right caliber.
- Suspicious or unverifiable details: the CLIP cosine threshold of 0.95 for text–image filtering (Sec. 3.1) is implausibly high on the usual CLIP similarity scale; "Qwen3.8-Max" does not match its cited reference; the "plan-then-generate (Li et al., 2026)" citation appears mismatched with GeoSVG-RL; the SAgoge dataset is used without a citation.
- CTRL-S lacks SArena-Illustration results without explanation; there is no failure-case analysis and no limitations section.
Questions for authors
- Is DEFT's increment over MOPD (Ma et al., 2026) — which you cite but never discuss — limited to an SVG-domain adaptation? Do command-level routing and the asymmetric KL constitute a general methodological contribution transferable to other structured/code generation tasks? If so, please argue or demonstrate it; if not, please articulate the independent methodological value beyond MOPD.
- What exactly is the CLIP similarity threshold of 0.95 in Sec. 3.1 (encoder, normalization)? How many samples survive it?
- Will SVGVerse and DEFT weights be released, under what license and timeline?
- The reconstruction evaluator is Qwen3-VL-8B-based and the generator is Qwen3-VL-8B-Instruct; does this family overlap bias data selection? What fraction of reconstructions underwent human review, and what was the correction rate?
- Is there any human-annotated gold standard for semantic component organization against which the reconstruction references themselves are validated?
Dear Reviewer Ghcf,
As the discussion deadline approaches, we thank you again for your constructive feedback on our methodological contribution, evaluation reliability, and baseline comparisons. We have clarified DEFT's distinction from MOPD through analysis and controlled comparisons, and illustrated potential extensions to Mermaid and TikZ. We also clarified the human validation process and downstream editing evidence, completed the CTRL-S results, and added complex illustration comparisons and failure analyses. We would appreciate your feedback on whether these additions and clarifications address your concerns. If you have any remaining questions, please let us know so that we can respond before the discussion closes.