- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the token fragmentation problem in generative OCR, with a particular focus on rare Chinese characters found in ancient texts. The authors argue that splitting a complete character shape into multiple output tokens may create a bottleneck at the output representation level. To address this, the paper proposes a character-shape-aligned output space adaptation method GAOSA: Assigns dedicated tokens to selected fragmented characters, initializes them using the mean of the representations of their original constituent tokens, and adjusts language-side parameters through page-level supervision.
The most compelling comparison starts from the same first-stage checkpoint and uses the same second-stage training samples. Experiments with a second backbone model provided evidence of compatibility, with the complete system achieving the lowest normalized edit distance (NED) among the compared systems on four Chinese classical text benchmarks. Since this method simultaneously modifies both the tokenization scheme and the optimization of the output layer, these results more directly support the effectiveness of the entire adaptation process, rather than merely demonstrating the effect of changes at the token granularity.
Critical strengths
Compared to simply adding supervised training, this approach achieved significant additional gains. The methods in Table 3 used the same initialization and the same second-stage training data; therefore, the 28.87 F1 percentage point improvement over conventional SFT is more convincing than a comparison with an unadapted external model. Modifying only the tokenizer without providing targeted supervision also failed to yield any improvement. These results support the practical value of this method in challenging OCR scenarios and demonstrate that simply constructing a new vocabulary is insufficient to generate benefits.
Critical weaknesses
-
The configuration of the existing SFT baseline needs to be explained more clearly. Sections 3.2–3.4 acknowledge that GAOSA simultaneously modifies both the word segmentation method and language-side optimization, but Table 3 does not list the trainable modules and input-output weight sharing schemes corresponding to the conventional SFT with the same level of clarity, which hinders an accurate understanding of the comparison results. It would be helpful to include a brief configuration table based on the completed experiments. The abstract and conclusions should also align with the qualifications in Section 3.4, presenting the benefits in terms of the effectiveness of the complete output space mapping scheme.
-
The annotation guidelines and the division of ancient text data require clarification. Section 4 states that the re-annotated reference transcriptions include page elements such as headers and footers, whereas Appendix A.2 and Figure 6 describe the removal of headers and footers as non-transcription noise. This may indicate that different guidelines were used for training and evaluation, but the paper has not yet clarified this point. Furthermore, the section on ancient text data needs to explain how the self-built training set and evaluation set were divided. These issues constitute insufficient reporting and do not imply that data contamination has been found or that the results are invalid. Clarifying the existing annotation guidelines and division process will help in assessing the meaning of the reported scores.
Questions for authors
- Existing baseline settings (request for clarification): Which modules were trained separately for the standard SFT and GAOSA in Table 3? Do the input embedding layer and the output head share weights? Please list the settings already used in a small table.
- Annotation Guidelines (Request for Clarification and Manuscript Revision): Do the reference transcriptions for AncientDoc and MTHv2 include headers and footers? Please explain the discrepancy between the descriptions in Section 4 and Appendix A.2/Figure 6, indicate whether different standards were intentionally used for training and evaluation, and briefly describe how the model outputs were processed prior to scoring.
- Existing Data Partitioning (Request for Clarification): How are FELDoc-1K and HCLDoc-582 separated from the training data? Please briefly describe the units used to partition real pages (e.g., pages or bibliographic entries/editions), and explain how synthetic evaluation pages are generated or reserved.
3 comments
Response to Weakness 2&Questions 2&3
Review Question:
Annotation Guidelines (Request for Clarification and Manuscript Revision): Do the reference transcriptions for AncientDoc and MTHv2 include headers and footers? Please explain the discrepancy between the descriptions in Section 4 and Appendix A.2/Figure 6, indicate whether different standards were intentionally used for training and evaluation, and briefly describe how the model outputs were processed prior to scoring.
Response:
We sincerely thank you for carefully identifying this inconsistency and apologize for the writing error in Section 4. To clarify, the reference transcriptions for both AncientDoc and MTHv2 exclude non-transcriptional elements, including headers, footers, and the central book-fold area. We follow a single, unified annotation protocol throughout our study, as described in Appendix A.2 and illustrated in Figure 6. No different annotation standards were intentionally applied to training and evaluation. The discrepancy in Section 4 was an editorial error, which we have corrected in the revised manuscript (4. Evaluation Datasets, lines #278–282).
The reason for reannotating AncientDoc and MTHv2 is that their original annotations cannot be reliably converted into the required page-to-sequence transcription format through rule-based methods. In particular, complex double-column annotations, historical reading orders, and text segmentation make it difficult to automatically construct accurate and consistently serialized reference transcriptions. Our manual re-annotation addresses these challenges and ensures consistency with the unified transcription protocol. These data have already been made available anonymously on Hugging Face (AnonymousGAOSA/AncientDoc_Plus and AnonymousGAOSA/MTHv2_Plus).
Regarding evaluation, no additional post-processing is applied to our model's generated transcriptions before scoring (4. Evaluation Datasets, lines #299–301). The decoded outputs are directly compared with the corresponding ground-truth references, without rule-based content filtering, reading-order correction, or layout reconstruction. This is also an advantage of our end-to-end page-to-sequence model: through supervision from both synthetic and manually annotated data, the model learns to identify relevant textual content, handle complex document layouts, follow the correct reading order, and exclude non-transcriptional elements directly during generation, rather than relying on external post-processing procedures.
Review Question:
Existing Data Partitioning (Request for Clarification): How are FELDoc-1K and HCLDoc-582 separated from the training data? Please briefly describe the units used to partition real pages (e.g., pages or bibliographic entries/editions), and explain how synthetic evaluation pages are generated or reserved.
Response:
We thank the reviewer for highlighting the need to clarify our data partitioning protocol. Following your suggestion, we have revised Section 4 (4. Evaluation Datasets, lines #285–290) to explicitly describe the partitioning units, synthetic evaluation data preparation, and training–evaluation separation.
Specifically, we adopt page-level partitioning based on unique page IDs, rather than partitioning by bibliographic entries or editions. The 291 real evaluation pages in HCLDoc-582 are strictly excluded from the 18,432 training pages.
For synthetic evaluation data, HCLDoc-582 contains 291 reserved, degradation-augmented synthetic pages, while FELDoc-1K consists of 1,000 synthetic pages generated separately using the same synthesis engine. All evaluation page IDs are excluded from both Stage-1 and Stage-2 training.
These clarifications have been incorporated into the revised manuscript to make the training–evaluation separation and benchmark construction protocols explicit.
Thank you to the authors for the detailed response. I appreciate the clarifications and the effort put into addressing my comments.
Response to Weakness 1&Question 1
We sincerely thank the reviewer for the thorough and positive evaluation of our work. We greatly appreciate your recognition of our approach to challenging OCR scenarios and your suggestions for our work. We have carefully considered all questions raised and provide our clarifications and responses below.
Review Question:
Response:
Thank you for raising this important question! Following your suggestion, we have explicitly clarified whether the input embedding and LM head share weights (Section 5.3, lines #417–419), as well as which modules are trained, in the revised manuscript (Section 5.3, lines #416–417).
Specifically, the original Qwen3.5-4B uses tied input embedding and output LM-head weights. Standard SFT retains this weight tying under the original tokenizer (τ₀), whereas GAOSA unties the embedding and LM head after vocabulary expansion under the glyph-aligned tokenizer (τ₁), allowing them to be optimized independently. In both configurations, the visual encoder and multimodal projector are frozen, LoRA is applied to the language backbone, and the embedding and LM-head parameters are updated during Stage-2 training.
A similar concern was also raised by another reviewer. To further address these concerns, we conducted additional controlled ablation experiments, which have been incorporated into the revised manuscript (Section 5.3, Table 3). The complete configurations and results are summarized below.
Here, ✓ and × indicate whether the corresponding parameters are updated during Stage-2 training, while Base denotes the Stage-1 checkpoint without Stage-2 adaptation.
Standard SFT and GAOSA correspond to Ablations 1 and 4, respectively. Both use the same Stage-1 checkpoint, training data, and supervision, with embedding and LM-head parameters updated in both configurations. GAOSA additionally introduces glyph-aligned atomic tokenization and its associated output-space adaptation, improving F1 from 59.68% to 88.55% (+28.87 percentage points). The remaining ablations further clarify the roles of embedding and LM-head adaptation.