- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies “Squint Text”: text embedded in coarse image structures that humans can recognize by squinting or reducing image scale, but multimodal language models often fail to transcribe. The authors introduce SquintBench, containing 1,076 production-derived images, and SquintCtrl, a synthetic diagnostic suite. They propose SquintOPSD, which distills a frozen teacher conditioned on the original image, a downscaled view, and the ground-truth transcription into a student receiving only the original image. The method achieves substantial improvements over the backbone, SFT, and DAPO, with transfer to external hidden-text benchmarks.
Critical strengths
- Relevant problem with practical motivation. Hidden-text recognition is a meaningful failure mode for visual content moderation. The combination of production-derived evaluation and controlled synthetic experiments is valuable.
Critical weaknesses
-
The evidence does not yet establish spatial selection as a major causal bottleneck. Oracle pooling uses exact glyph masks that encode shape as well as location, so its advantage over global/random pooling does not isolate localization. Moreover, vision-only adaptation substantially outperforms LM-only adaptation (71.12 vs. 29.25), suggesting an important role for representation changes. Location-only controls and interventions on the frozen model would strengthen this claim.
-
The target-form ablation may confound soft supervision with on-policy training. It is unclear whether SFT-distil and SquintOPSD share identical student-generated prefixes and training settings; thus, the 68.31→88.61 gain cannot be attributed solely to soft targets. A matched hard-versus-soft comparison is needed. The authors should also explain why the mismatched-view experiment uses a paired baseline of 84.60 rather than 88.61.
Questions for authors
-
Does SFT-distil use exactly the same on-policy student prefixes and optimization settings as SquintOPSD? What happens when only the soft teacher distribution is replaced by its argmax target?
-
What configuration differs between the default run and the matched/mismatched-view pair? Can the teacher-input ablations be reported under one consistent setting?
5 comments
Response to Reviewer QMgC — Part 2/2
W2. Confounding trajectory source and supervision form
The target-form ablation may confound soft supervision with on-policy training. It is unclear whether SFT-distil and SquintOPSD share identical student-generated prefixes and training settings; thus, the 68.31→88.61 gain cannot be attributed solely to soft targets. A matched hard-versus-soft comparison is needed. The authors should also explain why the mismatched-view experiment uses a paired baseline of 84.60 rather than 88.61.
Response to W2.
- Trajectory source and supervision form. Thank you for this suggestion. We agree that the original comparison between SFT-distil and Squint OPSD changes both trajectory source and supervision form; the full gain from 68.31 to 88.61 should not be attributed to soft targets alone. We therefore added a comparison. All four conditions use the same teacher, with the original image, a 1/8 thumbnail, and the GT hint.
| Trajectory source | Hard | Soft |
|---|---|---|
| Offline: cached teacher trajectories | 68.31 | 77.57 |
| Online: student-generated trajectories | 72.67 | 88.61 |
Within the same trajectory-source setting, online-hard and online-soft achieve 72.67 and 88.61, while offline-hard and offline-soft achieve 68.31 and 77.57. The soft-supervision scheme performs better under both trajectory sources.
The two online conditions each use trajectories generated by their own student; the individual prefixes are not required to be identical. We have added the settings and results to Table 4 and its analysis in §5.3 and revised the interpretation of the original comparison in Appendix C.
- Matched-view baseline. Thank you for identifying this inconsistency. We rechecked the experimental records and found that 84.60 was a reporting error in the manuscript; 88.61 is the correct single-checkpoint result. We have corrected the corresponding descriptions in §5.3 and Appendix C.
Q1. Student prefixes and hard-target supervision
Does SFT-distil use exactly the same on-policy student prefixes and optimization settings as SquintOPSD? What happens when only the soft teacher distribution is replaced by its argmax target?
Response to Q1.
Thank you for this question. SFT-distil in the original paper uses trajectories generated offline by the teacher, whereas Squint OPSD uses trajectories generated online by the student. They therefore do not use the same on-policy student prefixes, and the original comparison does not isolate supervision form.
We added an online-hard condition using the same teacher as Squint OPSD, with the original image, a 1/8 thumbnail, and the GT hint. Training uses student-generated online trajectories, with the teacher’s full-vocabulary argmax token at the current prefix as the hard target.
| Supervision on student-generated trajectories | ANLS |
|---|---|
| Hard: teacher argmax target | 72.67 |
| Soft: teacher distribution | 88.61 |
Online-hard achieves 72.67 ANLS, compared with 88.61 for soft supervision. Under our experimental settings, the scheme that retains the teacher distribution performs better.
We have added the online-hard result and experimental settings to Table 4 and its analysis in §5.3.
Q2. Matched-view configuration and the default setting
What configuration differs between the default run and the matched/mismatched-view pair? Can the teacher-input ablations be reported under one consistent setting?
Response to Q2.
Thank you for identifying this inconsistency. We rechecked the experimental records and found that the matched-view baseline of 84.60 was a reporting error; the correct result is 88.61. The matched- and mismatched-view conditions use the same experimental settings and differ only in whether the teacher’s auxiliary view matches the current example. Their ANLS scores are 88.61 and 78.60, respectively, a difference of 10.01 points.
The teacher-input ablations use a consistent setting, varying the information supplied to the teacher. We have corrected the corresponding numbers and descriptions in §5.3 and Appendix C.
Thank you for the additional experiments and clarifications, which have largely addressed my previous concerns. I see the paper’s main contributions as the diagnosis of squint-text recognition failures and a training approach tailored to this problem. Since SquintBench provides the main empirical evidence, its diversity and representativeness are important for assessing the generalizability of the reported gains. Could the authors provide a dataset link and access instructions? If access is restricted, a broader selection of representative images spanning different visual styles, text layouts, and sources, together with a brief description of the sampling and deduplication procedures, would help clarify the benchmark’s coverage.
Response to Reviewer QMgC — Part 1/2
We thank the reviewer for the constructive suggestions. We added controls for spatial pooling and trajectory source, clarified the supervision comparison, and checked the reported matched-view baseline.
W1. Spatial selection and visual representations
Response to W1.
Thank you for this suggestion. We agree that the original oracle pooling uses an exact glyph mask, so its advantage may reflect both text location and stroke shape. To further examine their roles, we added two pooling controls on features from the frozen visual encoder and used a linear probe for character recognition.
The two conditions use masks of exactly the same shape, but translation substantially reduces performance. Preserving the selector’s shape alone is therefore insufficient: selecting locations aligned with the text is important for reading out glyph information.
Together, these controls support spatial selection as an important factor in reading out hidden-text information. We have added the control settings and results in §3.2 and the Figure 2 caption and updated the corresponding statement in the abstract.