NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
446 results for “keyword:"benchmarks"” in ICLR 2027. 117 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]Can Agents Keep Secrets They Were Never Told? Benchmarking Latent Privacy Risks Across Sessions with MemJoin▲14k3.00
[PDF]ScaffoldBench: A Dynamic Benchmark for Evaluating Pedagogical Scaffolding and ZPD Alignment in Large Language Models▼4.3k2.00
[PDF]ShopLife-Bench: A Benchmark for Multi-Session Multi-User Agent Interaction in E-Commerce Environments▼1.2k1.67
[PDF]Representation and Motivation Are Superadditive: Unlocking Exploration for LLM Agents in Structured Search▲6.1k2.00
[PDF]Design, Not Noise: Certifying Cross-Model Claims in Black-Box Behavioural Audits of Language Models▲6.1k2.00
[PDF]CyberPersistBench: Evaluating LLM-Based Cyber Attackers on Installation and Persistence▼1.2k3.00
[PDF]MOVI-Agent: Learning Queryable Software Models from Instructional Videos for Professional GUI Automation▼4.3k2.00
[PDF]What Reviewers Catch and Frontier Models Miss: Statement-Level Errors in Autoformalization▲6.1k2.00
[PDF]HydroWrench: A Dataset and Benchmark for Dynamic Load Reconstruction in Bioinspired Aquatic Mechanisms▼4.5k2.25
[PDF]Beyond Success Rate: Interventional Evaluation of Memory in Vision-Language-Action Systems▲3952.67
[PDF]RISCForge-Bench: Benchmarking the Gap Between Local RTL and Processor-Extension Delivery▼5.8k2.33
[PDF]CoHabit Arena: Evaluating Personal Preference Realization in Long-Horizon Human-Agent CoHabitation▼1.2k1.67
[PDF]Correct After Rearrangement: A Tile-Permutation Test of Spatial Reliance in Vision-Language Benchmarks▼1361.33
[PDF]TCSALGBENCH: BENCHMARKING AUTOMATED PROVING FOR RESEARCH-LEVEL THEORETICAL COMPUTER SCIENCE▲5.4k3.00
[PDF]Is This Agent Evaluable? Certifying Verdicts About LLM Agents Under Nondeterminism, Oracle and Coverage Obstructions▼1.2k1.67
[PDF]Interactive Visual Gym: Evaluating visual assistants with simulated human users in interactive worlds▲143.33
[PDF]The Primitive Recursor Test: Construction-Recognition Gap and Representation-Shift Failure in Formal Reasoning▼4.3k2.00
[PDF]Benchmarking and Training Reward Models for Cross-Source Evidence Grounding in Search Agents▼3.7k2.25
[PDF]Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text▲3952.67
[PDF]AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement▼1.2k1.67
[PDF]When the Simulator Fails, Not the Policy: Auditing Contact Artifacts in Simulated Robot Benchmarks▲9.2k2.67
[PDF]Success Is Not Completion: Goal-Closure Monitoring and Corroborated Contracts for Tool-Using Agents▼5.8k2.33
[PDF]I2O2I-Nav: A Benchmark with a Modular Agent for Long-Horizon Indoor-to-Outdoor-to-Indoor Navigation▼5.8k2.33
[PDF]Reported Safe, Blind in Practice: A Cross-Modal Conflict Benchmark for the Action Layer of Multimodal Agents▼791.00
Withdrawn or desk rejected (117)
[PDF]Counterfactual Auditing of Object Presence and Quantity Judgments in Vision-Language ModelsWithdrawn1.67
[PDF]Correlation Does Not Certify a Policy Choice: What Benchmarks Should Publish InsteadWithdrawn2.33
[PDF]EarthArena: Benchmarking Agents on Real-world, Long-Horizon Scientific Tasks in Earth ObservationWithdrawn1.67
[PDF]AskInfer-Bench: Profiles Are Evidence, Not Intent Labels, in Personalized Deep ResearchWithdrawn1.00
[PDF]CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online ServicesDesk rejected2.00