- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces Glyph-to-Image: a model that turns Chinese characters into images of a target concept while keeping them readable. At test time, it optimizes the font’s own cubic Bézier outline together with a 64×64 RGB appearance map. A frozen text-to-image model guides the optimization through differentiable rendering. Two components control the trade-off between meaning and readability: an Appearance Low-Pass Filter (ALPF), which smooths the map and its gradients; Glyph Consistency Regularization (GCR), a margin-based penalty on deformations of neighbouring Bézier segments that go beyond rotation and uniform scaling.
Authors build single- and multi-character benchmarks (90 and 270 pairs) and propose the SGBS metric, which combines normalized CLIP-T with OCR confidence. They report the best overall SGBS against CLIPDraw, DS-Fusion, OracleFusion and VitaGlyph.
Critical strengths
I believe CLIPScore alone is insufficient even to capture semantic alignment, and I fully understand the need for a new metric: the work proposes SGBS, which jointly accounts for semantic alignment and glyph readability. It is a good addition.
Critical weaknesses
- I am mainly concerned about the novelty of the work. Diffusion-guided optimisation of vector font outlines has already been explored for semantic typography (e.g., Word-As-Image), yet the paper does not compare against it. With respect to this line of work, the main changes in the method seems to be a newer flow-based prior, a raster colour map, and GCR. GCR also seems a regularizer, similar to those used in prior work (e.g., Word-As-Image’s loss).
- Word-As-Image is a far more relevant baseline than CLIPDraw. A quantitative and qualitative comparison with it would help frame the contribution of this work.
- Minor: some relevant references are missing for the generative models: DreamFusion, vHector, Vector Grimoire and Text-to-Vector Generation with Neural Path Representation.
Questions for authors
-
CLIPDraw mentioned in Table 1 seems to be an adapted version that starts from glyph outlines (l. 358). Please describe this adaptation and clarify it in the tables. How does the adapted version differ from Word-As-Image, which already deforms glyph outlines under a diffusion prior? Could you also compare your method directly with Word-As-Image?
-
A human study with native readers would strengthen the evaluation, e.g., forced-choice concept recognition and character recognition, as in Word-As-Image. Reporting how well SGBS agrees with these human judgments would also help validate the metric.
-
L_T2M is only described in words (l. 203–207). Please define it explicitly.
-
How much does the appearance field contribute on its own? Could you add an outline-only variant (flat fill, no appearance field) and an appearance-only variant (outline frozen) to Table 4?
1 and 2 are most important.