acceptodds
Under review as a conference paper at ICLR 2027

SlideGate: Benchmarking Presentation Generation with Dimension-Specific Verification

Abstract

Automated presentation generation has entered practical use, enabling users to obtain complete slide decks from natural-language requests and optional reference materials. Such requests often involve delivery requirements, including slide count, formatting, source grounding, and mandatory content, while also requiring slides to be free of severe visual defects such as occlusion and cropping. We introduce SlideGate, a benchmark comprising 40 presentation-generation tasks across seven application scenarios and five input forms, with 2,191 task-specific verification items and a protocol that separately reports instruction following, content quality, and visual presentation. Applying SlideGate to 240 outputs from six publicly available commercial slide-generation systems, we obtain binary content-item judgments that agree with two independent blinded annotators at rates of 80.7% and 85.6%, respectively, and system rankings based on mean per-slide visual scores that correlate with human preference rankings at Spearman rho = 0.829. Across these outputs, SlideGate detects 124 decks with blocking failures, including hard instruction violations, missing required content, or page-level cropping or occlusion. Using scoring schemes based on the published criteria of six representative evaluation frameworks, the initial grouping analysis finds that three schemes assign significantly lower scores to decks with detected blocking failures, but the score gaps are small. When thresholds are set to detect approximately 90% of failing decks in leave-one-task-out validation, these three schemes incur false-positive rates of 76.8% to 98.8%. These findings highlight the value of combining task-specific verification with explicit failure diagnosis to reveal delivery issues that holistic scores may obscure.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.