- Rating
- 3(+1)
- Confidence
- 1(−2)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes LAYER, a framework for key information extraction that uses OCR text and layout during training to learn compact evidence representations from document images. It combines layout feature alignment with confidence gated contrastive learning to associate answer values with their source regions, then generates structured answers without OCR at inference time. Experiments on public KIE benchmarks demonstrate consistent gains over answer-only fine-tuning across three backbone sizes and a 2.03× end-to-end speedup over OCR-CoT under a fixed answer-length setting.
Critical strengths
-
combine both page layout and individual fields. Layout feature alignment helps the model learn page structure, while contrastive learning connects answer values to their source regions.
-
The model produces a fixed sequence of 64 latent vectors in one forward pass, and the paper reports a 2.03 times speedup over OCR CoT when answer length is held constant.
Critical weaknesses
-
With the development of end-to-end OCR models such as DeepSeek-OCR 2[1] and GLM-OCR[2], it is unclear what additional benefit LAYER’s explicit spatial layout supervision provides. The authors do not discuss this question or compare LAYER with these models on KIE tasks.
-
The experiments lack comparisons with some methods discussed in the Related Work section, such as LayoutLM and SCOLAR.
-
The authors do not discuss the training cost of LAYER or compare it with that of other methods.
[1]https://arxiv.org/abs/2601.20552 [2]https://arxiv.org/abs/2603.10910
Questions for authors
-
Why does LAYER require these relatively complex training mechanisms instead of directly using representations from the encoder of an existing multimodal document model, such as DeepSeek-OCR 2? What is the advantage of the proposed approach? Could the authors also provide KIE comparisons with recent end-to-end OCR models?
-
At line 208, how was Z* chosen as the teacher target? Do features extracted from the rendered image by the visual encoder have a particular meaning? Why not use features from an OCR encoder or hidden states from the prefill stage?
-
Could the authors provide additional comparisons with methods mentioned in the Related Work section, such as LayoutLM and SCOLAR?
-
Could the authors discuss the training cost of LAYER and compare it with that of other methods?
Thank you for the further clarification. I appreciate the authors' efforts and the additional explanations. I raise my score but lower the confidence. I still keep neutral about the work because the entire article lacks a sense of closure.