- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose a method for web RAG that avoids parsing HTML into text. Instead, it renders web pages into screenshots and divides them into fixed-size image tiles. Each tile is encoded using Qwen3-VL-Embedding, and the retrieved image tiles are then fed into a vision-language model for answer generation. The authors construct a screenshot-based index from web-scale Wikipedia data. They also synthesize queries based on webpage screenshots and fine-tune the embedding model through contrastive learning. On existing QA benchmarks (e.g., NQ and SimpleQA), this method outperforms text-based RAG approaches that rely on HTML parsers.
Critical strengths
One strength is that the paper proposes replacing the approach of cleaning webpage HTML into plain text with rendered webpage screenshots as the retrieval representation for large-scale web RAG. On existing QA benchmarks (e.g., NQ and SimpleQA), this method outperforms text-based RAG approaches using HTML parsers. This work challenges the default use of text representations in web RAG. Another strength is that the retrieval corpus used in the experiments is large-scale, consisting of a Wikipedia snapshot. The experimental results on this web-scale index demonstrate that the method's effectiveness is not limited to small document collections.
Critical weaknesses
One major weakness is that the method is similar to the pipeline of existing works such as VisRAG “VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents” Shi Yu. et.al. 2024. involving page image encoding, retrieval, and answer generation using a vision-language model. This work simply extends the existing paradigm of multimodal document RAG (e.g., VisRAG) to large-scale web data.
Questions for authors
What are some critical advantages over the existing work VisRAG?
We thank the reviewer for recognizing that the work challenges the default text representation in web RAG and that the evaluation runs at web scale.
W1 / Q1. Critical advantages over VisRAG
Reviewer: "The method is similar to the pipeline of existing works such as VisRAG ... This work simply extends the existing paradigm of multimodal document RAG (e.g., VisRAG) to large-scale web data. (Q1) What are some critical advantages over the existing work VisRAG?"
The key difference from VisRAG is the setting: VisRAG focuses on visually rich document retrieval, while PixelRAG studies web retrieval for predominantly text-centric tasks. While the benefits of visual retrieval on visually rich documents are largely expected, our surprising finding is that visual retrieval also significantly outperforms text retrieval on traditional text-centric tasks, where text has long been the default representation. This shift introduces three important differences:
In summary, VisRAG demonstrates that pixels help when visual information is essential; PixelRAG shows that pixels help even on traditional text-centric tasks and at the scale of a complete open-domain knowledge base. We will clarify these distinctions in the revised paper.