NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
446 results for “keyword:"benchmarks"” in ICLR 2027. 117 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]Machine Causality Stratification: Derived Authority, Reversible Causal Ledgers, and Coverage-Gated Capability▲11.00
[PDF]ScreenWritingBench: Evaluating LLMs Across the Screenwriting Workflow with Dimension-Specific Evaluation▼4.3k2.00
[PDF]AeroCopilotBench: Safety-Gated Evaluation of LLM Agents on Aircraft Emergency Procedures in an Executable Cockpit▲3.0k2.50
[PDF]ScreenMem: Benchmarking Proactive Memory Maintenance over Long-Horizon Computer-Use Streams▼11k2.33
[PDF]MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent▲5103.00
[PDF]Being Reasonable Is Not Enough: Measuring Selective Relationship Conditioning in Full-Duplex Speech Agents▼4.3k2.00
[PDF]AgentQoSBench: Evaluating Quality-of-Service Awareness in Agents under Complex Tool Dependencies▲5103.00
[PDF]CrossMaze: Benchmarking Zero-Shot Structural Generalization in Offline Continuous Control▼4.3k2.00
[PDF]Large-scale factor analysis shows machine intelligence is only partially interpretable▼1.2k1.67
[PDF]A Progressive Multi-Stage Multimodal Dataset and Benchmark for Real-World Chinese Emotion Recognition▼1361.33
[PDF]AM-Bench: Understanding Agents under Task Underspecification across Models and Harnesses▲3952.67
[PDF]StateTrackBench: Executable Trajectories for Locating Where Language Models Lose Track of Evolving State▲11.00
[PDF]PraxiScene: Benchmarking Agent Social Agency in Generated Open-Goal Interactive Scenarios▲3.0k2.50
[PDF]MedicalPressureBench: Evaluating Care Pathway Integrity of Medical Agents Under Workplace Pressure▼4.3k2.00
[PDF]RAF: RUBRICS AUTO-GENERATION FRAMEWORK FOR AUDITABLE EVALUATION OF LONG-HORIZON LLM AGENTS▼4.3k2.00
[PDF]PhyAudioBench: Benchmarking Physical Consistency in Audio Generation through Controlled Interventions▼1361.33
[PDF]From Seeing to Solving: Benchmarking and Diagnosing Symbolic Reasoning in Large Vision-Language Models▲9.2k2.67
[PDF]Does Multi-Agent Collaboration Pay When Agents Serve Users? Testing Agent Scaling in Dual-Control Settings▼1611.50
[PDF]Gains Stay Where the Loss Went: A Channel-by-Condition Map of Physical-Plausibility Training in Vision-Language Models▲3952.67
[PDF]CONTACT: A Human-Grounded Benchmark and Surprisal-Based Predictive Scorer for Conversational Naturalness▲13k2.33
[PDF]ChameleonBench: Evaluating the Cross-Environment Robustness Across Heterogeneous Systems▼1.2k1.67
[PDF]FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows▼4.5k2.67
[PDF]CNCGEN: A Dataset and Framework for Machining Process Planning and Toolpath Generation from B-rep Models▲3952.67
[PDF]When Agents Spend for Users: Benchmarking Economic Decision Security in A2A Marketplaces▼4.3k2.00
Withdrawn or desk rejected (117)
[PDF]Counterfactual Auditing of Object Presence and Quantity Judgments in Vision-Language ModelsWithdrawn1.67
[PDF]Correlation Does Not Certify a Policy Choice: What Benchmarks Should Publish InsteadWithdrawn2.33
[PDF]EarthArena: Benchmarking Agents on Real-world, Long-Horizon Scientific Tasks in Earth ObservationWithdrawn1.67
[PDF]AskInfer-Bench: Profiles Are Evidence, Not Intent Labels, in Personalized Deep ResearchWithdrawn1.00
[PDF]CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online ServicesDesk rejected2.00