- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces PRISM, a multi-agent framework for generating question-specific illustrations for reading comprehension. It coordinates evidence selection, shared visual style, and cross-question entity consistency while restricting direct answer disclosure. Experiments across four reading comprehension datasets show improved overall illustration quality compared with existing methods. Downstream evaluations suggest that the illustrations improve VLM question-answering accuracy when textual evidence is limited.
Critical strengths
- The paper clearly defines the task of generating question specific illustrations while maintaining consistency across a passage.
- Shared style planning and entity routing provide explicit mechanisms for coordinating visual appearance across different question specific scenes.
- The direct framework operates with frozen pretrained models, without requiring task-specific parameter updates.
Critical weaknesses
- Evidence of downstream usefulness remains limited. Figure 3 shows: with the full passage available, PRISM decreases accuracy on three of four student VLMs and provides no consistent improvement over text alone.
- Improvements under reduced text settings may primarily reflect information supplementation. The generator accesses the full passage and correct answers, whereas students receive incomplete text. Without a control supplying equivalent evidence as additional text, the benefit of visual presentation remains unclear.
- The improvement over a simpler monolithic approach is modest relative to the additional computational cost. Monolithic prompt induction achieves a GeoMean of 65.5 versus PRISM’s 66.0, with substantially lower runtime.
Questions for authors
Could the authors clarify the practical value of the generated illustrations beyond improvements in visual quality? Given the inconsistent gains with full passages, it remains unclear whether the benefits under reduced-text conditions arise from visual presentation or simply from supplying missing evidence. A comparison with equivalent textual support would help establish whether these benefits justify the additional computational cost.