- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes T³-Doc, a text-aware, training-free token-pruning method for reducing redundant computation in document parsing. It detects text regions, merges and expands them to build an adaptive token-retention mask, and applies the mask either before or after visual encoding. On OmniDocBench, it prunes about 30% of visual tokens while maintaining parsing accuracy, and reduces TTFT by up to 30.9%.
Critical strengths
-
The paper is clearly written, and the proposed method is simple and practical.
-
The method uses text regions to preserve important document content, adapts token retention to each page, and supports pruning before or after visual encoding without additional training.
Critical weaknesses
-
Although T³-Doc is evaluated on several end-to-end document parsers, the paper does not directly assess how well detected text regions cover all information needed for parsing, particularly non-text structural cues such as table boundaries, figures, and spatial relationships. Its discussion of missed detections addresses part of this issue, but the impact of uncovered informative regions remains unclear.
-
The efficiency results exclude text-detector latency, and the cost of mask construction is not separately reported. Consequently, the paper does not establish the method’s end-to-end latency benefit when its additional processing is included.
-
The paper compares against attention-based and feature-based pruning methods, but does not isolate the contribution of the selection criterion under identical pruning placement and per-page token budgets. It also lacks a component ablation of box merging and region dilation.
Questions for authors
-
How often does the retention mask exclude ground-truth content or structural elements, and how does this affect parsing accuracy?
-
Could you report end-to-end latency, including PP-OCRv6-Medium detection and mask construction, alongside a breakdown of each component?
-
Could you compare text-region, attention-based, and feature-similarity-based selection while holding pruning placement and per-page retained token counts fixed? Could you also ablate box merging and region dilation separately?
-
Regarding PreV, wouldn't the irregular shape changes of the visual embeddings before entering the encoder cause the encoder to fail during execution?