- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes the AdvSpot benchmark and ArmorOCR training framework to study large multimodal models' perception capability for hard-to-recognize and hard-to-locate visual text. AdvSpot contains 383 images with region-level annotations, covering 5 categories and 13 text patterns. ArmorOCR employs two-stage training: first distilling visual cues from transformed views, then optimizing text recognition, region localization, and question answering through task rewards.
Critical strengths
- The paper evaluates whether models can localize text regions, not merely whether final answers are correct, providing a more complete view of OCR perception.
- The distillation stage leverages visual cues from transformed views, while the reinforcement stage separately optimizes recognition, localization, detection, and region-level QA.
- AdvSpot provides text regions, transcriptions, pattern categories, and region-level QA, facilitating analysis of different error types.
- Results demonstrate that multiple framework components contribute gains, and performance on other adversarial OCR and general OCR benchmarks is reported.
Critical weaknesses
I have the following concerns:
- AdvSpot's overall size is modest, with relatively few samples per fine-grained category, and results may be influenced by sample selection.
- Some categories more closely resemble general OCR hard cases, and the boundary with adversarial patterns such as concealment and encoding remains insufficiently clear.
- Training data is generated by synthetic pipelines and filtered by specific OCR patterns and base model performance; model behavior on different sources or novel text patterns remains unclear.
- ArmorOCR is primarily trained on Qwen3-VL-8B, and whether the training scheme transfers to other model architectures has not been demonstrated.
- The method requires synthesizing large volumes of training samples and conducting two-stage training; the paper offers limited discussion of the relationship between training resource investment and performance gains.
Questions for authors
see weakness
review
The authors have adequately addressed my concerns. I am satisfied with their responses and clarifications, and I am happy to maintain my positive rating.