- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates end-to-end transcription of cuneiform tablet photographs using a single vision-language model. The authors address a key limitation of existing cuneiform OCR approaches that multi-stage pipelines that separately optimize localization, recognition, and sequencing suffer from sparse sign-box annotations and error propagation across stages. The paper proposes an encoder-projector-decoder architecture that jointly learns visual sign recognition and sequence generation without explicit bounding-box supervision. A experimental contribution is the systematic comparison of four training curricula assembled from five fixed phases.
Critical strengths
The paper clearly identifies the tension between modular pipelines and direct end-to-end training. The finding that direct Phase-5-only training learns a language-only shortcut is a compelling and practically important result.
The encoder-projector-decoder architecture is simple and well-suited to the task. The modification to disable spatial downsampling in SwinV2 is a well-justified intervention that addresses the convergence failure observed with standard downsampling.
The finding that curriculum specifics matter less than whether any pretraining occurs is a valuable empirical insight.
The construction of synthetic lines and synthetic tablet sides from real sign crops provides intermediate supervision between isolated sign recognition and full tablet transcription, bridging a critical gap in the data-constrained cuneiform setting.
Critical weaknesses
The paper notes that the 1→2→3→4→5 curriculum achieves slightly lower localization than 1→2→5, speculating that synthetic images introduce domain mismatch. However, this is not systematically analyzed. A quantitative comparison of attention alignment on synthetic or real images, or an ablation isolating synthetic line or synthetic tablet-side training, would clarify the source of the degradation.
Localization is evaluated on small-scale annotated signs. While this is a reasonable diagnostic set, it is relatively small compared to the whole transcription test set. The localization results may not generalize across the full range of tablet styles, periods, or preservation conditions.
The paper argues that end-to-end transcription is an alternative to multi-stage pipelines, but does not directly compare with these methods on the same test set. A direct comparison would strengthen the claim that single-model image-to-sequence transcription is competitive.
The synthetic lines and tablet sides are composed from real sign crops, but the paper does not evaluate whether these synthetic examples are visually realistic or whether models trained on them learn spurious cues.
The model uses SwinV2-Tiny. It is unclear whether the findings, particularly the language-only shortcut and the curriculum convergence, would hold for larger models or different architectures.
Questions for authors
Could you provide a quantitative comparison of attention alignment on synthetic or real images, or an ablation isolating synthetic line or synthetic tablet-side training?
How well do these localization results generalize across the full range of tablet styles, periods, and preservation conditions? Would a larger or more diverse holdout change the relative ranking of curricula?
Can you provide comparisons with multi-stage pipelines?
The synthetic lines and tablet sides are composed from real sign crops, but you do not evaluate whether these synthetic examples are visually realistic or whether models trained on them learn spurious cues. Have you conducted a human or model-based realism assessment?
Would the language-only shortcut and the curriculum convergence findings hold for larger models or different decoder architectures?
Thank you for your feedback. We have posted an official comment detailing the new baseline comparisons and benchmarks, and we have updated the manuscript. It reports the new results from 2 additional seeds, fine-tuned eBL DETR and PaddleOCR-VL baselines, along with free-generation localization results.
Synthetic ablations We have added two runs (1-2-3-5 and 1-2-4-5) that isolate the synthetic line and synthetic side phases. The two schedules had similar transcription scores, but the line-only schedule had slightly higher free-generation peak in box (~2%) and less variation across seeds. The averaged results across 3 seeds show the full curriculum, which includes both synthetic stages, achieved the highest mean localization scores among TabletVLM variants under both reference conditioning and free generation. Given these results, we removed the original suggestion, based on a single seed, that the synthetic stages might hurt localization.
Synthetic realism The synthetic data in this study provided intermediate supervision to bridge the gap between individual signs and whole tablet images, rather than as a tool to create additional training data. The images are assembled by stitching sign crops into horizontal lines, and stitching the lines together. We have not evaluated the realism of the synthetic images. After the additional seed runs, the results show the synthetic data helps improve localization performance and stability.
Localization holdout We agree that the 879 annotated sign positions across 79 tablets are a limited test of generalization, but they represent all the available data for this study. Additional data would require manual labeling by experts, or inclusion of other periods which would significantly expand vocabulary size and variation in sign appearance.
Model scale and architecture We kept the architecture fixed so we could study the effect of training curriculum. The language-only shortcut only applies to the TabletVLM configuration we tested. Whether the same training behavior holds across different model sizes remains an open question.