- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors propose a comparative study of 3 different architectures to extract information from structured documents (forms). The proposed architectures are three:
i) one based on object detector (YOLO), which they use to detect text regions before applying an OCR;
ii) one based on a VLM that extracts the information directly from the image, without using OCRs; and
iii) a hybrid one that combines the two previous architectures.
The experiments are carried out on their own datasets and are not compared with reference datasets such as FUNSD (https://guillaumejaume.github.io/FUNSD/)
Critical strengths
None
Critical weaknesses
It essentially is a technical work that combines pre-trained modules. If any model finetuning was done, I was unable to identify it in the manuscript. Moreover, the kind of architectures proposed, at the levei that is done in the paper, does not usually require finetuning
The paper does not provide any relevant scientific contribution. The authors are unaware of what has been published in the field of document analysis in recent years. A simple search by a web search engine with the keywords: "yolo" + "document analysis". It points to a paper, from 2024, (https://arxiv.org/pdf/2410.12628) that presents similar ideas to the “classical” one proposed. In the ICDAR proceedings of 2026 and earlier, one can find works that already propose hybrid schemes based on agency architectures that propose better methods than those proposed by them.
It is necessary to evaluate their proposed architectures in benchmark datasets, e.g FUNSD, IIT-CDIP or RVL-CDIP.
Questions for authors
-
I strongly suggest to the authors making a more exhaustive literature review in the field of Document Image Analysis Recognition and Understanding. In addition to the reference cited above, I recommend reviewing ICDAR’s proceedings of the last years, or specialist journals in the field such as IJDAR.
-
The authors refer to the problem of processing sensitive data or data protected by legislation, but in their evaluation of their methods there are no experiments related to this topic. The development of document analysis methods that preserve data privacy by design is still a hot topic in the document image analysis community