- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes a two-stage framework for glyph and script similarity learning. Stage 1 trains a teacher with supervised contrastive learning on labeled invented alphabets, while Stage 2 adapts the representation to historical scripts using teacher-initialized BYOL without cross-script negatives. The learned glyph embeddings are aggregated into script-level distances and evaluated using few-shot glyph retrieval and curated script-relation rankings. Across five backbones, the method achieves the best NDCG@10 on three, while the results on glyph retrieval and Spearman correlation are more mixed.
Critical strengths
- The problem formulation is interesting. The distinction between reliable glyph-level supervision and uncertain cross-script historical relations is meaningful, and avoiding potentially false cross-script negatives is well motivated.
- The evaluation covers several useful settings. The paper considers five backbones, together with both glyph-level retrieval and script-level ranking. The frozen Stage-1 teacher and Stage-2-only BYOL experiments are also useful controls.
Critical weaknesses
- The script-level ground truth conflicts with the paper’s central motivation. The paper argues that unknown historical relationships should not be treated as negatives, but during evaluation every pair not explicitly assigned to Levels 1–3 is treated as unrelated. This may introduce exactly the type of assumption the training framework is designed to avoid.
- The evidence that Stage 2 itself provides a robust improvement is weak. The proposed method is best in NDCG@10 on three of five backbones and is worse than the frozen SupCon teacher on the Siamese CNN and essentially similar on ResNet-18. Some improvements are also very small, e.g., 0.2927 vs. 0.2895 on ResNet-34. Meanwhile, Spearman is worse than competing methods on most backbones.
- The “self-supervised” Stage 2 is not fully label-free as described. Instead of using two augmentations of the same image as standard BYOL does, the method samples different handwritten instances from the same character class. Selecting such pairs requires knowledge of character identity, so this is closer to positive-pair supervision than fully unlabeled self-supervision.
- The methodological novelty is fairly limited. Stage 1 is standard SupCon and Stage 2 is essentially BYOL initialized from the Stage-1 encoder, with a few architectural/data-pairing modifications.
Questions for authors
- What happens if unannotated script pairs are treated as unknown rather than unrelated?
- Does Stage 2 actually require character identity labels? How are two distinct handwritten instances of the same character selected without knowing their class?
- How much improvement comes specifically from the transition to BYOL? Can the authors provide a clearer analysis of when and why Stage 2 helps?
- How sensitive are the conclusions to the manually curated similarity hierarchy? It would be useful to report robustness to alternative label definitions or evaluation restricted to well-established relationships.
Response to Reviewer fpGN
Thank you for a demanding review: it led to our most informative analyses. You found the formulation meaningful and the avoidance of false cross-script negatives well motivated. The new results demonstrate both halves of the design. They use 3 seeds and 95% CIs over seeds × query scripts; time limited us to 3 seeds, too few for a reliable sd. The revised PDF answers every point; locations below, changes in blue.
W2 / Q3b — We isolated a robust gain. It lies in the two-stage design.
Revision: §4.3, Fig. 3; App. C.3–C.4, Tables 13–15.
Q3a — What comes from BYOL?
Revision: §4.4, Fig. 4; App. C.5, Table 16.
W1 / Q1 — Unannotated pairs.
Revision: §3.3–3.4; App. C.7.
Q4 — Sensitivity to the hierarchy. ✓ = 95% CI above 0; ≈+ = positive, n.s.; ≈ = near zero.
Over 4 backbones × 8 definitions, "Ours > w/o Stage 1" is positive in 31 of 32 cases and significant in 21. The only reversal concerns Ours vs Barlow on ResNet-34, already a tie, under the family hierarchy. Revision: App. C.7, Table 18.
W3 / Q2 — Character identity in Stage 2. Correct, and it is the reliable half of the supervision: renderings of one character are safe positives, while relations between scripts are not.
Stage 2 is now described as a negative-free adaptation with within-character positives. Revision: §3.1, Fig. 1.
W4 — Novelty. The contribution is a supervision principle, now backed by evidence:
Revision: §1, contributions.
In short: the evaluation convention drives no conclusion, we isolated a robust, significant gain that stays stable across ground truths, and Stage 2 is described precisely. We hope this resolves your soundness concerns, and we would be very grateful if you would raise your scores.