- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OmniPresent, a unified framework for generating coherent presentation suites, including posters, slides, videos, and project pages, from a single research paper.
It introduces a shared Knowledge Stream and Cross-Artifact Verification to detect and correct factual inconsistencies and missing content across formats.
It proposes Experiential Planner Learning (EPL), which leverages accumulated verification failures to improve planner instructions for future papers.
It introduces OmniPreBench, a benchmark comprising 1,036 papers with paired presentation artifacts, along with an LLM/VLM-as-a-Judge evaluation protocol.
Critical strengths
The paper addresses the practical and important problem of cross-format consistency, moving beyond existing artifact-specific generation approaches.
The proposed self-improving framework leverages past verification experience to refine planners, rather than merely correcting individual outputs.
The paper provides extensive comparisons across multiple backbone models and baselines, supported by CV/EPL ablation studies and human evaluation.
Critical weaknesses
Key components of OmniPresent have already been explored in prior work, including unified multi-format generation in PaperX, feedback-driven self-improvement in EvoPresent, and iterative multi-agent refinement in Paper2Poster. The proposed framework primarily combines these existing ideas, with limited methodological novelty beyond their integration.
EPL primarily updates planner instructions (prompts), but concrete examples of these updates and analyses explaining their effectiveness are lacking. Moreover, improvements in final FactScore and QA are not consistently statistically significant.
(Limitations of Cross-Artifact Verification) The framework uses Slides as the backbone for checking content coverage across Poster and Page, while direct verification of Video and post-rendering outputs is limited. The assumption that Slides should cover all salient content from other formats may also be overly restrictive.
The contributions of individual components, particularly the Shared Knowledge Stream, are not adequately isolated, making it difficult to determine their respective effectiveness.
Questions for authors
I would appreciate it if the authors could address the concerns raised in the weaknesses above.