- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents ChronoOBS, a framework for oracle bone script decipherment using incomplete and unaligned historical glyph lineages. Its main contribution is to jointly learn from historical forms across script periods, rather than relying on direct mapping or independent stage-wise translation. The method achieves strong Top-1 decipherment accuracy, compared with direct mapping under the same architecture. Independent verification on known character categories also evaluates the period recognizability and character-identity consistency of generated intermediate trajectories.
Critical strengths
- The motivation is interesting: leveraging the context of script evolution to aid decipherment.
- The paper proposes an elegant model to realize this idea and achieves strong Top-1 accuracy.
Critical weaknesses
-
Insufficient validation of intermediate trajectories on unseen character categories.The paper’s primary decipherment task focuses on category-level generalization, yet the intermediate trajectory verification in Section 4.3 and Appendix J is restricted to known character categories. The presented evidence does not establish whether the generated intermediate glyphs preserve character identity and remain structurally plausible on unseen categories. Independent assessment by paleographic experts is also lacking. Consequently, it remains unclear whether these generated trajectories serve as reliable intermediate representations in the core decipherment setting.
-
Incremental methodological novelty.The overall framework builds on existing autoregressive diffusion approaches. The design of DOTM appears largely incremental, and it yields only a modest improvement over Static OT (path signatures).
Questions for authors
Why were intermediate trajectories not quantitatively evaluated on held-out deciphered categories? Is this due to insufficient period-specific reference glyphs or the chosen evaluation protocol?
9 comments
Response to Reviewer fTbr (Part 2)
To assess structural plausibility beyond automated recognition, we have also added a study with nine experts covering two evaluation tasks: evaluation on held-out deciphered categories and evaluation on real-world undeciphered or disputed characters. Each expert assessed ten randomly sampled OBS glyphs, with five for each task.
For the first task, experts compared trajectories generated by Cascade, ChronoOBS w/o DOTM, and full ChronoOBS. They judged the plausibility of each proposed reading with a yes/no response and rated trajectory consistency and glyph quality on a four-point scale (1 = Poor, 2 = Fair, 3 = Good, 4 = Excellent). Trajectory consistency assesses structural coherence across script periods, while glyph quality assesses visual clarity and well-formedness. We report the percentage of yes responses and the mean rating, with 45 assessments per method and criterion.
| Criterion | Cascade | ChronoOBS w/o DOTM | ChronoOBS |
|---|---|---|---|
| Readings judged plausible (%) | 6.7 | 37.8 | 46.7 |
| Trajectory consistency (1–4) | 1.51 | 2.93 | 3.11 |
| Glyph quality (1–4) | 1.42 | 3.02 | 3.11 |
ChronoOBS receives the highest scores on all three criteria. In particular, experts rate its trajectory consistency at 3.11/4, compared with 1.51/4 for Cascade and 2.93/4 without DOTM, while its glyph quality is also rated 3.11/4. These judgments complement the automatic identity-preservation results with human assessment of the structural coherence and visual quality of trajectories on held-out categories.
For the second task, we assessed ChronoOBS on real-world undeciphered or disputed characters using the same evaluation setup, with research usefulness as an additional metric:
| Criterion | ChronoOBS |
|---|---|
| Readings judged plausible (%) | 31.1 |
| Trajectory consistency (1–4) | 2.96 |
| Glyph quality (1–4) | 2.84 |
| Research usefulness (1–4) | 2.45 |
On real-world undeciphered or disputed characters, experts rated trajectory consistency at 2.96/4 and glyph quality at 2.84/4, both close to 3 (Good). These assessments indicate that ChronoOBS maintains coherent intermediate trajectories and good generation quality in this setting.
We have added Sec. 4.6, “Expert Evaluation,” and Tables 7–8 to the revised manuscript to report the study protocol and results. Appendix N provides the evaluation-criterion definitions and detailed score distributions.
Response to Reviewer fTbr (Part 3)
W2. Incremental methodological novelty.The overall framework builds on existing autoregressive diffusion approaches. The design of DOTM appears largely incremental, and it yields only a modest improvement over Static OT (path signatures).
We would like to clarify where our contributions lie, which go beyond applying existing autoregressive diffusion and optimal transport techniques.
First, the contribution is not the autoregressive-diffusion backbone itself but how incomplete historical evidence is used. Under the same architecture, cascading through the intermediate periods is worse than ignoring them (9.8% vs. 21.8%), auxiliary supervision changes little (22.1%), and joint modeling is what helps (24.4%). Unlike MAR, where autoregression runs over tokens within one image, ChronoOBS runs it across script periods, with placeholders and period dropping so that incomplete lineages can be used for training and decoded along multiple paths. The surviving historical forms provide valuable evidence for bridging the gap between ancient and modern glyphs. Their organization into discrete, chronologically ordered stages motivates our choice: autoregressive modeling captures cross-period dependencies, while diffusion represents the diversity of glyph shapes within each stage.
Second, we would also like to clarify that the entry labeled “Static OT (path signatures)” refers to the static matching formulation developed in this work: the path-signature cost is the static term of DOTM's cost (Sec. 3.3, Eq. 8). To the best of our knowledge, this work is the first to combine path signatures with optimal transport to establish soft correspondences among ancient Chinese glyph variants across historical script periods. We therefore view this static formulation as one part of our contribution to cross-period glyph matching; its comparison with DOTM examines the additional effect of the adaptive extension within our approach. Against matching baselines that are not ours (Table 4), random matching reaches 22.9% and static OT with standard pixel or VGG costs 23.1–23.2%, whereas our path-signature cost reaches 23.7% and full DOTM 24.4%. The matching design therefore accounts for 1.5 of the 2.6-point gain over Direct (21.8%).
Third, DOTM addresses the difficulty that fixed morphological similarity may not fully capture evolutionary relationships. It updates matching distances using the cross-period structure learned during training and assesses correspondences jointly across whole trajectories. We see its contribution in allowing glyph alignment and evolution modeling to inform one another, so that matching reflects both morphological similarity and compatibility within an evolutionary trajectory.
In summary, our contribution is driven by a specific decipherment challenge: making use of historical evidence with missing stages and unknown variant correspondences. The innovation lies in the problem formulation and the adaptation of these techniques into a joint framework, where alignment and evolution modeling inform one another to make incomplete historical lineages useful for oracle bone script decipherment.
Reply to questions.
Q1. Why were intermediate trajectories not quantitatively evaluated on held-out deciphered categories? Is this due to insufficient period-specific reference glyphs or the chosen evaluation protocol?
Thank you for raising this question. This was due to the original evaluation protocol rather than a lack of reference glyphs: our trajectory verifiers covered only known character categories and therefore could not assess character identity on held-out decipherment categories. Authentic intermediate-period glyphs are available for some held-out categories.
We have now expanded verifier training to cover all character categories available in each script period, with evaluation images excluded from training, and extended trajectory evaluation to held-out deciphered categories with available reference glyphs. As detailed in our reply to W1, we have added these results to Sec. 4.3, Table 3, and clarified the verifier protocol in Appendix J of the revised manuscript.
Response to Reviewer fTbr (Part 1)
Dear Reviewer fTbr,
Thank you for your valuable comments and suggestions. We have carefully addressed each comment and provide our point-by-point responses below.
Reply to weakness.
W1. Insufficient validation of intermediate trajectories on unseen character categories. The paper’s primary decipherment task focuses on category-level generalization, yet the intermediate trajectory verification in Section 4.3 and Appendix J is restricted to known character categories. The presented evidence does not establish whether the generated intermediate glyphs preserve character identity and remain structurally plausible on unseen categories. Independent assessment by paleographic experts is also lacking. Consequently, it remains unclear whether these generated trajectories serve as reliable intermediate representations in the core decipherment setting.
Thank you for highlighting these concerns. We have addressed both concerns by extending quantitative trajectory verification to held-out deciphered categories and adding independent expert assessment.
Specifically, we have expanded verifier training to cover all character categories available in each script period, including categories held out from generator training. This enables us to evaluate generated intermediate glyphs on held-out deciphered categories for which authentic period-specific records are available. Evaluation images are excluded from verifier training, and the verifiers are used only for evaluation. The expanded evaluation measures script-period recognizability, character-identity preservation, and retrieval against authentic glyphs, with the complete results shown below.
All-period consistency requires the correct character to appear in the verifier's Top-5 at each of the four intermediate periods. On held-out categories, ChronoOBS achieves 88.9% period accuracy, 21.4% mean character Top-5 accuracy, and 13.1% all-period consistency, compared with 70.6%, 9.3%, and 2.9% for Cascade. These results show that the improvement in period recognizability and character-identity preservation extends to categories unseen by the generator. The authentic-glyph rows provide a reference. For these zero-shot categories, identity accuracy at the intermediate periods (18.9–23.4%) is in line with the final decipherment accuracy itself (24.4%).
In the revised manuscript, we have extended Sec. 4.3, “Intermediate Trajectory Verification,” and added the “Decipherment” block to Table 3. Sec. 4.3 and Appendix J now explicitly state that verifier training covers all available character categories in each script period, with evaluation images excluded from training.