- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces ReflowText, an English-to-English visual text editing benchmark focusing on long-form content, multi-region replacement, and source-to-target length mismatches. It also presents ReflowJudge, a VLM-based evaluator that complements OCR-based metrics by assessing font-style consistency, layout and reflow quality, and background preservation. Furthermore, the authors propose GlyphPlan, a VLM-based layout planner that predicts line-level text arrangements and provides spatially aligned glyph conditions to guide the image editing process. Experiments on two open-source editing backbones demonstrate improvements in editing quality, particularly in font-style consistency and layout.
Critical strengths
-
The paper focuses on a relatively underexplored setting in visual text editing, particularly long-form text replacement, length mismatches, and layout adaptation. The proposed ReflowJudge also provides a task-specific evaluation framework based on an open-weight VLM, which could be useful for future research and benchmarking.
-
The paper explores a layout-first approach using a VLM to predict line-level text placement before image editing. This provides an explicit way to separate layout planning from visual rendering, and the experiments show some improvements in font-style consistency and layout quality.
Critical weaknesses
-
Although ReflowText covers several important challenges in visual text editing, the paper mainly presents overall performance comparisons and a few qualitative examples. I would like to see more detailed analyses of how different models perform under varying text lengths, length mismatches, and numbers of edited regions. Combined with representative visualizations, these analyses could help identify the main failure modes and limitations of current editing models, making the benchmark more informative.
-
Previous works, such as TextDiffuser-2 and WeEdit, have explored language-model-based layout planning for visual text generation or editing. While GlyphPlan offers a trainable line-level planning approach, I'd like to understand how much benefit comes from the planner's specialized training. For example, how would a strong yet affordable zero-shot VLM (e.g., GPT-6 Luna) perform as the layout planner in the same editing pipeline? Such a comparison would help clarify the practical advantages of GlyphPlan. Additional details about the planner's training data would also be useful.
Questions for authors
-
Could the authors provide more detailed results across different text lengths, length mismatches, and numbers of edited regions? It would be helpful to understand where current models tend to fail and which challenges remain the most difficult. Representative failure cases would also be useful.
-
Have the authors considered using a strong zero-shot but affordable VLM (e.g., GPT-6 Luna) to generate the line-level layouts instead of training a dedicated planner? Such a comparison could help clarify the benefits of the proposed training strategy.
-
GlyphPlan uses a standard font to render glyph conditions without explicitly encoding the original typography. However, Table 5 shows noticeable improvements in font-style consistency. Could the authors further explain this observation? In particular, I would be interested in seeing how GlyphPlan performs when the original font style differs substantially from the standard glyph font, such as highly decorative or handwritten text. Some qualitative examples or a breakdown of performance in such cases would help demonstrate whether spatially aligned glyph conditions are sufficient for preserving diverse font styles.
6 comments
Thank you for the thorough rebuttal. Your new experiments in Tables 16–20 address Q1 and Q2 well. However, my concern about Q3 remains:
- A ~1.5% rise in source-text attention (Table 22) is quite small to explain the large Style gain.
- In ReflowJudge (Appendix D.3), the Style metric also checks basic character legibility (glyph integrity), so much of the gain may simply come from cleaner text rendering rather than better font-style transfer.
- In Figure 17 ((b), (c), and (f)), SFT + GlyphPlan still turns handwritten and chalkboard text into standard printed fonts.
To clarify this without running new experiments, could you report the Style scores from Table 5 (SFT no glyph vs. SFT + GlyphPlan) specifically on stylized subcategories like Handwritten Casual and Movie Poster from your existing logs? Alternatively, if you have other effective ways to demonstrate this point, those would also be very welcome.
Further Evidence and Analysis of Font-Style Preservation
Thank you for the prompt follow-up and for recognizing that the new experiments address Q1 and Q2. We apologize that our previous response did not fully resolve your concern about Q3. We respond below.
1. Evidence that GlyphPlan improves font-style preservation.
We agree that glyph integrity contributes to ReflowJudge's Style criterion. However, the large Style gains in Table 5 accompany only small changes in foreground text accuracy. Each entry below shows SFT without glyphs → SFT + GlyphPlan:
| Editor | FG-NED ↓ | FG-Recall ↑ | Style ↑ |
|---|---|---|---|
| SenseNova-U1.5 | 19.70 → 18.57 | 57.91 → 57.10 | 62.23 → 73.06 |
| Qwen-Image-Edit | 28.97 → 28.46 | 37.53 → 38.29 | 54.87 → 60.02 |
In particular, SenseNova gains 10.83 Style points while FG-Recall slightly decreases; Qwen gains 5.15 Style points with only a 0.76-point increase in FG-Recall. These results indicate that glyph integrity is not the main driver of the Style gains and does not alter our conclusion that GlyphPlan improves font-style preservation.
Following your suggestion, we also extracted Style scores for Handwritten Casual and Movie Poster from our evaluation logs:
| Subcategory | Editor | SFT without glyphs | SFT + GlyphPlan |
|---|---|---|---|
| Handwritten Casual | SenseNova-U1.5 | 49.35 | 59.16 |
| Handwritten Casual | Qwen-Image-Edit | 53.82 | 63.36 |
| Movie Poster | SenseNova-U1.5 | 52.33 | 60.51 |
| Movie Poster | Qwen-Image-Edit | 50.19 | 56.91 |
The gains persist on both stylized subcategories and both editors. We agree that the font styles in Figure 17 still retain some AI-generated characteristics and are not yet perfect. Nevertheless, GlyphPlan preserves the original font style substantially better than no-glyph SFT. For example, the word “Thanks” in Figure 17(b) looks noticeably closer to natural handwriting with GlyphPlan than with no-glyph SFT. We attribute the remaining tendency toward standard fonts to the editors' learned appearance priors and the limited representation of difficult fonts in our training data. GlyphPlan alleviates this limitation without fully resolving it. Further addressing it calls for dedicated research, such as handwriting generation[1] and artistic typography[2], together with substantial training data tailored to these styles.
2. Feature-level analysis toward interpreting the mechanism behind Style gains.
We agree that the 1.45–1.68 percentage-point attention increase alone is insufficient to establish the proposed mechanism behind the Style gains. To explore the mechanism from another perspective, we compare source–output text-region similarity using DINOv2 and diffusion features. Detailed experimental settings and full results are provided in Appendix I.3, Tables 23–24.
| Editor | Feature | Without glyphs | With GlyphPlan | Relative gain | 95% CI of absolute gain | Holm-adjusted p |
|---|---|---|---|---|---|---|
| SenseNova-U1.5 | DINOv2 | 0.79096 | 0.80574 | +1.87% | [0.01137, 0.01828] | 1.87e-14 |
| SenseNova-U1.5 | Diffusion | 0.80404 | 0.81956 | +1.93% | [0.01246, 0.01860] | 1.54e-20 |
| Qwen-Image-Edit | DINOv2 | 0.78704 | 0.81116 | +3.06% | [0.01988, 0.02859] | 4.77e-24 |
| Qwen-Image-Edit | Diffusion | 0.79400 | 0.81105 | +2.15% | [0.01282, 0.02138] | 7.43e-13 |
All four improvements remain significant after Holm correction. A fixed-region control over all 2,002 images also shows significant gains for both editors and both feature types.
The layer-wise results are consistent (Table 24). Entries show SFT without glyphs → SFT + GlyphPlan, with relative gains in parentheses:
| Transformer layer | SenseNova-U1.5 | Qwen-Image-Edit |
|---|---|---|
| 6 | 0.83622 → 0.85083 (+1.75%) | 0.83066 → 0.84436 (+1.65%) |
| 18 | 0.82854 → 0.84343 (+1.80%) | 0.81998 → 0.83488 (+1.82%) |
| 30 | 0.83789 → 0.85165 (+1.64%) | 0.83114 → 0.84405 (+1.55%) |
| 41 | 0.80404 → 0.81956 (+1.93%) | 0.79400 → 0.81105 (+2.15%) |
| 53 | 0.79621 → 0.80775 (+1.45%) | 0.79524 → 0.80755 (+1.55%) |
Both editors show positive mean gains across all five reported transformer layers. Together with the attention maps, these results support better source-appearance preservation across feature types and layers.
Thank you for your constructive feedback and guidance. We hope that our response and additional evidence address your concerns.
[1] Nikolaidou, Konstantina, et al. "Diffusionpen: Towards controlling the style of handwritten text generation." European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2024.
[2] Tanveer, Maham, et al. "Ds-fusion: Artistic typography via discriminated and stylized diffusion." 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2023.
Response to Reviewer Us3U
Thank you for the constructive suggestions and for highlighting the font-style improvement. We have added stratified results, controlled planner comparisons, and further analysis of font-style preservation.
Q1. Results stratified by difficulty.
Appendix B.3 adds text-load and replacement-length distributions. Appendix G further breaks down the results of the 14 models in the main paper’s Table 3 by text load, replacement-length mismatch, number of edited regions, and domain. The table below reports equally weighted mean Final scores across these models on a 0–100 scale, in the same order as the groups. Text load sums target characters across all edited regions in an image.
Full per-model results appear in Tables 16–18, with visual summaries in Figures 12–15.
All 14 editors score lower in the highest versus lowest text-load and region-count groups, highlighting the difficulty of accurately rendering longer text and coordinating multiple replacements. Both contraction and expansion also score below equal total word count, as length mismatch can disrupt alignment and complicate reflow. Across domains, documents are the hardest; newspapers, academic papers, and reports score 37.52, 45.75, and 47.31, respectively, compared with 72.12 for presentation slides (Fig. 14), highlighting the challenges of text-dense content. Figure 16 presents typical failure cases: long-text replacement produces garbled text and incorrect characters, length mismatch causes layout errors, background elements are lost, and decorative or handwritten text suffers from font-style inconsistencies.
Q2. Can a strong zero-shot VLM serve as the planner?
We compare GlyphPlan with six alternative planners: three closed-source API models, including GPT-6 Luna, and three open-weight VLMs without task-specific fine-tuning. The renderer, with-glyph SFT editor, editing prompt, and sampling settings remain fixed. Only the planner changes, and all 2,002 images remain in evaluation on SenseNova-U1.5 and Qwen-Image-Edit-2511. Final scores are summarized below; complete results for all six evaluation metrics and Final are provided in Appendix H.1, Tables 19–20:
GlyphPlan improves Final over GPT-6 Luna by 4.54/5.43 points and over its unadapted Qwen3.6 planner base by 2.66/5.65 (SenseNova/Qwen). GPT-6.1 Sol is competitive on individual metrics, but GlyphPlan has the highest Final on both editors. API planners require recurring service charges; GlyphPlan can be deployed locally.
Q3. Why can standard-font glyphs improve handwriting and decorative styles?
Table 5 shows improved Style on both editors under matched SFT settings:
We appreciate your suggestion to examine challenging font styles and have followed it by evaluating examples from Natural Scene – Handwritten Casual, comparing ordinary zero-shot, no-glyph SFT, and SFT + GlyphPlan editing (Fig. 17, Appendix I.1). The visualizations show more natural handwritten and decorative lettering with GlyphPlan, with better fidelity to the source font style, color, and character proportions than the baselines.
GlyphPlan decouples text-layout planning from image editing, allowing the editor to devote more expressive capacity to font-style preservation and focus more on the original lettering in the source image. Our attention experiment supports this explanation: measuring attention from queries in the generated editing region to source-image keys, both editors allocate a larger share to source-text regions on average across all 2,002 benchmark images (Table 22, Appendix I.2):
The attention maps in Figure 18 clearly show increased attention concentrated on the original text regions, alongside more natural handwriting in the edited output. This suggests that greater attention to the source lettering helps the editor retain its font-style features.