- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper addresses the task of cross-script font generation and proposes the HR-Font method, which aims to generate Latin characters, Japanese kana, and Zhuyin symbols with consistent stylistic attributes based on a small set of Chinese reference characters. The authors argue that existing methods primarily focus on the extraction and transfer of stylistic features while overlooking the geometric structural variations and local appearance adaptation required when generating characters across different writing systems. To address this, the paper introduces two core modules: (1) Character Realization Prior (CRP), which retrieves similar fonts from an existing library using a pre-trained style encoder and provides structural priors for the generation process by analyzing the feature differences between the target character in candidate fonts and the standard glyph; and (2) Target-Character Appearance Completion (TC), which queries multi-scale local features from reference characters based on target character features and supervises the generation of aligned appearance representations using the perceptual features of the target glyph. Experimental results demonstrate that the method achieves superior style consistency and perceptual quality in cross-script font generation tasks, with expert subjective evaluations also confirming its significant advantages.
Critical strengths
- The paper addresses the challenge of adapting the geometric structure and local appearance of target characters during cross-script font generation; treating these two aspects as complementary modeling objectives is a sound approach.
- The CRP and TC components enhance the generation process by leveraging structural priors and local appearance, respectively, and are integrated into an existing diffusion-based generation framework; the overall technical approach is clear.
- Experiments were conducted across multiple target writing systems, accompanied by module ablation studies, comparisons of retrieval strategies, and expert subjective evaluations. The expert evaluation results, in particular, provide evidence supporting the method's effectiveness in maintaining font style consistency.
Critical weaknesses
- CRP requires candidate fonts to contain both the input reference characters and the target characters, thereby relying on external font libraries capable of cross-script character coverage. This prerequisite may be difficult to satisfy for writing systems with limited font resources.
- A key premise of CRP is that a single font maintains stylistic consistency across different writing systems. While this assumption is intuitively plausible, the paper needs to provide supporting evidence—such as displaying glyph samples of the same font across different scripts or offering analysis from other perspectives. Without this, the design rationale for CRP lacks sufficient justification.
- The necessity of the dynamic candidate strategy remains unclear. The paper's retrieval ablation studies show that the "Uniform Top-K" approach performs almost identically to the full method; in fact, retaining only the Top-1 candidate font yielded superior results on reconstruction metrics such as LPIPS, L1, and SSIM.
- Font generation tasks typically include an evaluation setting for UFUC (Unseen Fonts, Unseen Characters), yet this paper omits such an experiment. Since all target characters used in testing were present in the training data, the model's generalization capability regarding unseen characters has not yet been verified. Besides, I suggest that the authors set aside a subset of Chinese fonts and characters for evaluation. As I understand it, the strategy proposed in this paper is language-agnostic; evaluating it in this context would strengthen the paper.
The literature review is insufficient; many methods in the field of font generation have been omitted, such as CG-GAN (CVPR 2022), IF-Font (NeurIPS 2024) and numerous recent approaches.
Overall, this is an interesting approach. Unlike CF-Font, which seeks an optimal content representation, this paper achieves style transfer by identifying font examples with similar styles to serve as priors. However, the current submission feels somewhat hasty; if the authors can adequately address my concerns, I would be open to raising my score.
Questions for authors
N/A
7 comments
Answer 2
Q2: A key premise of CRP is that a single font maintains stylistic consistency across different writing systems. While this assumption is intuitively plausible, the paper needs to provide supporting evidence—such as displaying glyph samples of the same font across different scripts or offering analysis from other perspectives. Without this, the design rationale for CRP lacks sufficient justification.
A2: Thank you for asking us to support cross-script retrieval with real glyphs and quantitative evidence.
Real glyphs. Figure 9(a) in the revised paper shows heavy, blocky strokes in row 2, thick–thin contrast in row 4, and pixel-grid outlines in rows 7–8 across Chinese, Latin, kana, and Bopomofo. Figure 9(b) overlays several real forms of each character with a red neutral skeleton in the same coordinate frame, showing variation in the reach of the left- and right-falling strokes of 「永」, the width and crossbar position of A, the loop shape of あ, and the turn and stroke-ending direction of ㄅ. These examples provide qualitative support for CRP’s design. Chinese references help identify fonts with related styles, and donors of the same character provide real examples of structural variation relative to the neutral glyph.
Retrieval versus random selection. To test whether similarities between Chinese reference glyphs carry over to the target scripts, we rank eligible candidates using only 8 Chinese reference glyphs for each of the 8,638 test requests. For each request, we measure the distance between each donor glyph and the ground-truth glyph for the same character. The same rules apply to both retrieval and random selection.
| Target script | Requests | Mean LPIPS for retrieved donors ↓ | Mean LPIPS for 10 randomly selected donors ↓ |
|---|---|---|---|
| Overall | 8,638 | 0.22621 | 0.29457 |
| Latin | 3,542 | 0.21452 | 0.28439 |
| Kana | 4,726 | 0.24041 | 0.31071 |
| Bopomofo | 370 | 0.24695 | 0.31237 |
| Test-set metric | 10 retrieved donors | 10 randomly selected donors |
|---|---|---|
| Nearest-donor LPIPS ↓ | 0.12482 | 0.18783 |
| Mean L1 ↓ | 0.08970 | 0.11786 |
| Nearest-donor L1 ↓ | 0.05498 | 0.07469 |
Compared with randomly selecting donors from the same candidate set, the retrieved donors have a 23.21% lower overall mean LPIPS distance to the ground truth. By script, the reductions are 24.57% for Latin, 22.63% for kana, and 20.94% for Bopomofo. For retrieved donors, the LPIPS distance from the nearest donor to the ground truth is 33.55% lower, while mean L1 and the nearest donor’s L1 distance to the ground truth are 23.90% and 26.39% lower, respectively. This shows that, for the current bank and evaluated scripts, similarity rankings based on Chinese references are informative for target glyphs. CRP then uses the retrieved glyphs' feature differences relative to the neutral glyph as structural guidance.
To compare donor counts on the same 8,638 font–character pairs, we retain the top 1, 2, 4, and 10 retrieved donors and take the same number from a random sequence sampled without replacement. The variance, minimum, and maximum in the table summarize mean LPIPS across requests, while the nearest-donor column takes the minimum LPIPS for each request and then averages with equal weight per font.
| Retained donors | Selection method | Mean LPIPS ↓ | Variance | Minimum | Maximum | Mean nearest-donor LPIPS ↓ |
|---|---|---|---|---|---|---|
| 1 | Retrieved using Chinese references | 0.19294 | 0.00982 | 0.00369 | 0.65115 | 0.19294 |
| 1 | Random selection | 0.29446 | 0.01221 | 0.01307 | 0.71810 | 0.29446 |
| 2 | Retrieved using Chinese references | 0.20689 | 0.00754 | 0.01086 | 0.64650 | 0.16196 |
| 2 | Random selection | 0.29522 | 0.00853 | 0.05119 | 0.69800 | 0.24941 |
| 4 | Retrieved using Chinese references | 0.21488 | 0.00703 | 0.01389 | 0.60625 | 0.14232 |
| 4 | Random selection | 0.29473 | 0.00664 | 0.05993 | 0.68477 | 0.21593 |
| 10 | Retrieved using Chinese references | 0.22621 | 0.00696 | 0.03031 | 0.59974 | 0.12482 |
| 10 | Random selection | 0.29457 | 0.00552 | 0.08156 | 0.65764 | 0.18783 |
Retrieval has lower mean LPIPS than random selection at all four donor counts. As the donor count increases from 1 to 10, the mean LPIPS of the retrieved donors rises from 0.19294 to 0.22621, while the mean LPIPS of the nearest donor falls from 0.19294 to 0.12482. With random selection, the mean LPIPS of the nearest donor also falls, from 0.29446 to 0.18783. These results support using Chinese references to retrieve glyphs for the target typeface.
Answer 3
Q3: The necessity of the dynamic candidate strategy remains unclear. The paper's retrieval ablation studies show that the "Uniform Top-K" approach performs almost identically to the full method; in fact, retaining only the Top-1 candidate font yielded superior results on reconstruction metrics such as LPIPS, L1, and SSIM.
A3: Thank you for highlighting the Uniform Top-K and Top-1 results, which helped us clarify the scope of CRP’s contribution. The core contribution of CRP is to represent structural variation across donor glyphs of the same target character and use it to guide deformation of the denoiser’s skip features. Dynamic weighting is one way to aggregate this structural information and is the strategy used in our default configuration. We have clarified this distinction in the contribution statement in Section 1 and in the candidate analysis in Section 4.5 (Table 7B).
On the full test set, uniform weighting and dynamic routing give similar results on all four metrics. Top-1 performs better on the reconstruction metrics L1, SSIM, and LPIPS, and the two configurations have similar mean SC.
| Condition | L1 ↓ | SSIM ↑ | LPIPS ↓ | SC ↑ |
|---|---|---|---|---|
| Full (dynamic routing, Top-10) | 0.084549 | 0.739638 | 0.176435 | 0.699777 |
| Uniform Top-K | 0.084568(+0.02%) | 0.739591(−0.01%) | 0.176462(+0.02%) | 0.699714(−0.01%) |
| Retrieval Top-1 | 0.080835(−4.39%) | 0.748479(+1.20%) | 0.171600(−2.74%) | 0.698470(−0.19%) |
| Random donors | 0.087100(+3.02%) | 0.733961(−0.77%) | 0.180701(+2.42%) | 0.695751(−0.58%) |
Uniform weighting and dynamic routing. The percentages in the table are relative to Full. Uniform Top-K differs from Full by +0.02% in LPIPS and −0.01% in SC. Uniform weighting and dynamic routing yield nearly identical results. One possible explanation is that CRP learns during training to extract useful structural information from donor features, so it can still use those features effectively with uniform weights at inference.
Reconstruction and style with a single donor. Relative to Full, Top-1 lowers L1 and LPIPS by 4.39% and 2.74%, respectively, and raises SSIM by 1.20%. These metrics measure how close the output is to the ground-truth glyph. Style Compatibility (SC) measures consistency with the reference style, with mean values of 0.69847 for Top-1 and 0.69978 for Top-10. In Figure 11 of the revised paper, our visual inspection shows that the angle and length of the upper bar of F vary, while both forms retain the sharp corners and tapered strokes of the Chinese references. The long stroke of ゾ is more curved with Top-10 and straighter with Top-1, and both retain the stroke-width variation of the references. Based on the mean SC and these examples, we observe that using a single donor or aggregating multiple donors can produce different glyph forms while preserving recognizable features of the reference style.
Purpose of the default configuration. We use Top-10 as the default in the main experiments to evaluate how the same model aggregates structural guidance from multiple donors. Top-1 is an option that produces glyphs closer to the ground truth with the same model. The Random donors condition draws the same number of donors at random from the eligible candidate set, yielding LPIPS 2.42% higher and SC 0.58% lower than Full. These results show that CRP's structural guidance can be used with dynamic routing, uniform weighting, or a single donor. CRP's contribution is to represent structural variation through different forms of the same target character and use those variations to modulate the denoiser's skip features.
Answer 1
Thank you for identifying bank coverage, the rationale for cross-script retrieval, and generalization to unseen characters as questions that needed further investigation. We added candidate coverage statistics, a zero-donor fallback, real glyph examples across scripts, retrieval controls, a formal UFUC evaluation, and a Chinese holdout evaluation. The revised paper explicitly reports results for uniform weighting, Top-1, and dynamic routing, centers CRP’s contribution on structural guidance from same-character glyphs, and expands the related work.
Q1: CRP requires candidate fonts to contain both the input reference characters and the target characters, thereby relying on external font libraries capable of cross-script character coverage. This prerequisite may be difficult to satisfy for writing systems with limited font resources.
A1: Thank you for pointing out that low-resource scripts may lack candidates from fonts that cover both the references and the target character.
Bank coverage. Under the current retrieval rule, a glyph is eligible only if its font covers the target character and all reference characters. The test set contains 8,638 font–character pairs, each with 8 references. The median number of eligible candidates is 309, and every request has at least 10. Of the three scripts, Bopomofo has the lowest median at 175 and Latin has the highest at 418.
Using few or no donors. If the bank contains no eligible candidate, the model skips the CRP deformation residual and continues generation using the neutral target glyph and the reference style. For low-resource scripts, the available structural guidance depends on the coverage and quality of glyphs in the bank. On a fixed set of 256 font–character pairs, we retained 0, 1, 2, 4, or 10 of the top-ranked donors (see Figure 10 in the revised paper for the full donor-count curve). Retrieval Top-1 lowers LPIPS by 4.77% relative to using no donors. Parentheses in the tables indicate changes relative to the corresponding no-donor condition. On the 256-pair panel, a single donor gives the best paired reconstruction, and every tested nonzero donor count achieves a higher mean SC than Top-0. Across the nonzero budgets listed in the table below, L1 and LPIPS are at least 2.33% and 1.59% lower than Top-0, respectively. The examples in Figure 11 suggest that aggregating several donors can support alternative glyph forms that retain the reference style.
Cyrillic bank coverage comparison. To evaluate the low-resource setting, we also tested 16 Cyrillic characters in 3 target fonts. These characters appear in neither the training character manifest nor the original bank. We compare the original bank with no donors against a bank expanded only at evaluation time to supply 4 donors. Both conditions use the same 8 Chinese reference glyphs, neutral target glyphs, noise, and sampling settings.
Relative to the original bank with no donors, adding 4 donors lowers LPIPS by 6.88% and raises SC by 4.58%, with all four mean metrics improving across the three target fonts. This shows that CRP can yield gains even with very few donors.