- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies which token representations support handwriting layout prediction on an unseen script. It keeps the layout model and training procedure fixed and compares character-compositional embeddings, an expanded-vocabulary control, Unicode token length, explicit rendered-glyph geometry, and frozen ImageNet-pretrained ResNet-18 features. English, Chinese, and Bengali are used in leave-one-script-out experiments. The visual representation improves on the expanded-vocabulary baseline in all three transfer directions. In the main English+Chinese-to-Bengali experiment, a width-only representation achieves cross-script layout loss close to the visual representation, although its in-domain loss is higher. Linear probes show that rendered width is recoverable from the visual features on the held-out script. Reconstruction with ground-truth handwritten crops provides an additional evaluation of the predicted layouts, rather than an end-to-end evaluation with a learned handwriting renderer.
Critical strengths
1.The comparison separates vocabulary coverage from the benefit of rendered visual input. In Table 2a, expanding the character vocabulary reduces cross-script loss from 160.934 to 22.314, and VIS reduces it further to 14.521; these values use the table's scaled units. Table 2b also shows lower VIS loss than EVCC in the other two transfer directions. This is useful evidence that the visual representation offers more than a remedy for missing vocabulary entries. Keeping the layout backbone fixed makes the representation comparison easier to interpret. 2.The simple geometry baselines make the empirical finding more informative. On English+Chinese-to-Bengali, W obtains 14.201 ± 0.498 cross-script loss versus 14.521 ± 0.828 for VIS, while VIS has lower in-domain loss (Table 2a). The width probe also transfers well, with cross-script R² = 0.896 (Table 3). Together, these results identify rendered width as a useful low-dimensional input in this setting, without requiring a new layout architecture. The value is the demonstrated sufficiency of a simple feature for comparable transfer performance; the small difference in means does not establish that W is superior to VIS.
Critical weaknesses
1.The evidence for the geometric explanation is narrower than the cross-script representation claim. W, WH, WHD, and the probe analysis are evaluated only for English+Chinese-to-Bengali. The other two directions compare EVCC with VIS, so they establish the visual representation's advantage over that baseline but do not test whether coarse geometry recovers it. This distinction matters because Chinese uses predominantly character-level tokens, whereas English and Bengali use predominantly word-level tokens (Appendix A.2). A width-based explanation may behave differently when Chinese is the target. The probe establishes that width can be decoded from VIS, not that the layout predictor uses width to obtain its transfer gains. The current evidence supports a useful result for the primary direction, but a broader characterization of the information enabling transfer needs either the corresponding geometry comparisons in the other directions or a more explicit restriction of the conclusion. 2.Inconsistent descriptions and results leave parts of the controlled comparison unresolved. Section 5 states that VIS uses a fixed font supporting all three scripts, thereby avoiding script-specific font differences, whereas Appendix A.3 specifies GoNotoCurrent-Regular.ttf for non-Hanzi/non-Korean tokens and NotoSansSC-Regular.ttf for simplified Chinese. Section 3.2.5 normalizes width and height by their training-set 95th percentiles, but Appendix A.3 uses the constants 384 and 64. These choices directly define the representations being compared. In addition, the three EVCC cross-script entries in Table 9 average to approximately 21.410 in Table 2's units, rather than the 22.314 reported in Table 2a. The seed-1001 pair in Table 9, 0.008956/0.018960, matches the other transfer direction's aggregate entries in Table 2b after rescaling. These could be reporting errors, and they do not by themselves overturn VIS's advantage, but the actual configuration and corrected results are needed to assess the study's control and reproducibility.
Questions for authors
1.Scope of the main finding: Do W, WH, and WHD recover a comparable fraction of VIS's transfer performance in the two other leave-one-script-out directions, especially when Chinese is held out? If these results are unavailable, would you restrict the coarse-geometry conclusion to English+Chinese-to-Bengali? This is a check of the existing central claim, not a request to add new scripts or a new rendering system. 2.Implementation clarification: Which font assignment and width/height normalization produced Tables 2 and 3? Please reconcile Section 5 with Appendix A.3, and Section 3.2.5 with Appendix A.3. If different fonts were used across scripts, what supports the statement that script-specific font differences were avoided? 3.Numerical clarification: Please provide the correct EVCC seed-1001 results for the primary direction and reconcile Table 9 with Table 2a. Also clarify which results outside the primary comparison are single-seed: Table 8 lists only seed 1001 for the other two directions, while Appendix A.5 broadly refers to three seeds. Correcting a table transcription error would substantially reduce this reporting concern; a change to the underlying comparison would require reassessing the results.
3 comments
Response to Concerns Regarding Implementation Details - Font Use and Token Image Span Normalisation
We thank the reviewer for identifying these inconsistencies:
Implementation clarification: Which font assignment and width/height normalization produced Tables 2 and 3? Please reconcile Section 5 with Appendix A.3, and Section 3.2.5 with Appendix A.3. If different fonts were used across scripts, what supports the statement that script-specific font differences were avoided?
We would like to clarify that all reported experiments use fixed width and height normalization constants of 384 and 64, respectively.
The reference to normalization using the 95th-percentile values of the training set was inadvertently retained from an initial pilot experiment. For all reported results, we fixed the normalization constants to 384 and 64 to maintain consistency across experiments and avoid introducing variation from experiment-specific normalization values.
We have removed the incorrect description from Section 3.3.5 (formerly 3.2.5) (lines 284-285) and updated Appendix A.3 to reflect the actual implementation. (lines 822-827)
We used GoNotoCurrent-Regular.ttf for English and Bengali tokens and NotoSansSC-Regular.ttf for Chinese tokens. Both fonts belong to the Google Noto Font family and were selected to provide coverage for the scripts considered in our experiments.
We acknowledge that using fonts from the same broader family does not guarantee the elimination of script-specific typographic differences. Although the Noto fonts are developed under a common design direction, individual scripts may retain differences in glyph design and metrics. Consequently, our use of these fonts should not be interpreted as fully controlling for all script-specific font characteristics.
We have revised Section 5 (Lines 482–483) to clarify the fixed font family and removed the implication that script-specific font differences are entirely avoided. Appendix A.3 has been updated to discuss the font family selection (lines 818-821). References to a fixed font in Section 3.3 have been qualified to indicate a fixed font family (lines 274-275,lines 283-284).
Response to the Numerical Clarifications Regarding EVCC and the number of Random Seeds
We thank the reviewer for highlighting the reporting error in Table 14 (formerly Table 9) of the Appendix and the reference to the number of random seeds in Appendix A.5:
3.Numerical clarification: Please provide the correct EVCC seed-1001 results for the primary direction and reconcile Table 9 with Table 2a. Also clarify which results outside the primary comparison are single-seed: Table 8 lists only seed 1001 for the other two directions, while Appendix A.5 broadly refers to three seeds. Correcting a table transcription error would substantially reduce this reporting concern; a change to the underlying comparison would require reassessing the results.
We would like to clarify that the EVCC results for seed 1001 in the primary transfer direction in the table were inadvertently replaced with the corresponding results from the BN+ZH-to-EN direction. The correct seed-1001 results for the primary direction are:
| Representation | ID Loss | CS Loss |
|---|---|---|
| EVCC | 0.007911 | 0.021671 |
We have corrected the table accordingly. The discrepancy was caused by a manual transcription error in Table 14 (formerly Table 9) alone. We have verified that the experimental outputs and the aggregate EVCC results reported in Table 3 (formerly Table 2a) and elsewhere are correct.
We also acknowledge that the description in Appendix A.5 was ambiguous regarding the number of random seeds. The three-seed evaluation applies only to the primary transfer direction. The experiments for the other two transfer directions use seed 1001 alone. We have revised Appendix A.5 to state this explicitly (lines 884-887): All reported results for the Primary evaluation direction are obtained using random seeds 1001, 1729, and 2027. All results that use a single seed are obtained using the random seed 1001.
Response To Concerns Regarding Generalisation of Width-Based Features
We thank the reviewer for their insights and appreciate that they recognise the value of our separation of vocabulary coverage and performance advantage of rendered visual input. We address your concerns regarding generalisability below; Reviewer thmM had also raised a similar concern:
We thank the reviewer for highlighting this limitation. In response, we have extended the evaluation of W, WH, and WHD to the other two leave-one-script-out directions. The results are now presented together in Table 3 (Lines 384–394). As these evaluations were conducted with a single seed (1001) due to their computational cost, we report them as additional empirical evidence of cross-direction generalization, not as statistically conclusive comparisons. The original EN+ZH → BN results retain their multi-seed evaluation.
Our results show that explicit geometric representations indeed generalize across all three transfer directions, although the most effective geometric representation varies by direction.
Interestingly, in EN+BN→ZH, where Chinese is held out, WHD achieves better performance in both the ID and CS settings, suggesting that the degree of dominance of VIS itself may depend on the transfer direction.
We have therefore revised our interpretation to distinguish the general transferability of explicit geometric representations from the stronger claim that width alone is universally sufficient or superior. We believe these additional results substantially strengthen the evidence for the transferability of geometric representations while motivating further investigation into script-dependent geometric properties.