NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
185 results for “keyword:"lm evaluation"” in ICLR 2027. 30 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]AlphaIdeaBench: Benchmarking Automated Research Idea Generation under Feasibility Constraints with Peer Review Alignment▲3952.67
[PDF]TriEval: A Three-Facet Framework for Modeling Capability, Task Difficulty, and Prompt Sensitivity in LLM Evaluation▼1.2k1.67
[PDF]CONSTRUCTING A PROVENANCE-ATTRIBUTION BENCHMARK OVER THE SCIENTIFIC LITERATURE: A SUPPLY CENSUS AND A SHORTCUT GATE▼1611.50
[PDF]Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark▼1.2k1.67
[PDF]Beyond Symmetric Agents: Cognitive Diversity and Multiagent Debate in Small Language Models▼1.2k1.67
[PDF]THE JUDGE LOTTERY: DIAGNOSING WHETHER COMPARISONS BETWEEN STOCHASTIC LLM JUDGES ARE ADEQUATELY SUPPORTED BY RESAMPLING EVIDENCE▼1361.33
[PDF]Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents▲3952.67
[PDF]Fighting Fire with Fire: Assessing Test Set Contamination via Deliberate Training on Test Data▲3.0k2.33
[PDF]HyperLogic: A Hard, Forward-Authored Chinese Logical Reasoning Benchmark with Execution-Derived Answers▲14k3.00
[PDF]RHContrast: A Matched-Control Benchmark for Evaluating Reward-Hacking Risks in Long-Form LLM Responses▲3.0k2.33
[PDF]SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models▼1.2k1.67
[PDF]MAFIA 1K: A Large-Scale Benchmark for Social Deductive Reasoning from Simulated Game Logs▼4.3k2.00
[PDF]Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers▼5.8k2.33
[PDF]Rethinking Item Response Theory for LLM Evaluation with Item-Marginalized Maximum Likelihood▼2443.33
[PDF]Beyond Scalar Leaderboards: Adaptive Sampling for Pareto Frontier Identification in Multi-Objective LLM Arenas▼4.3k2.00
[PDF]Symbolic Music Reasoning Needs Checkers That Survive Rewording: What a High Score Covers▼1.2k1.67
Withdrawn or desk rejected (30)
[PDF]ArenaBencher: Automatic Benchmark Evolution via Multi-Model Competitive EvaluationDesk rejected2.00
[PDF]Ace Olympiad Math, Fail Simple Arithmetic: Systematic Capability Unreliability in LLMsDesk rejected
[PDF]Smaller Than the Noise: A Measurement-Theoretic Audit of Evaluation Protocols for LLMsWithdrawn1.33
[PDF]When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey ResponsesWithdrawn1.33
[PDF]Validating Rankings from Pairwise ComparisonsDesk rejected