NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
218 results for “keyword:"llm as a judge"” in ICLR 2027. 27 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]True Quotes, False Impressions: A Benchmark for Adversarial Extractive Summarization on Long-Document Classification▼4.3k2.00
[PDF]More Reasoning Does Not Always Make a Better Judge: Understanding Inference-Time Compute in LLM Evaluation▼1.2k1.67
[PDF]WHEN SELF-PREFERENCE IS A VERIFICATION FAILURE: CAUSAL EVIDENCE FROM VISION-LANGUAGE JUDGES▼5.8k2.33
[PDF]True Claims, False Answer: Spot-Check Debate Is Limited by What the Honest Side Claims▼1.2k3.00
[PDF]THE JUDGE LOTTERY: DIAGNOSING WHETHER COMPARISONS BETWEEN STOCHASTIC LLM JUDGES ARE ADEQUATELY SUPPORTED BY RESAMPLING EVIDENCE▼1361.33
[PDF]What Transfers from a VLM Teacher? Comparing Supervision Signals for Visual Document Retrieval▲5103.00
[PDF]Quantiles, Not Points: Streaming Quantile Matching for Ordinal-Aware LLM-as-a-Judge Calibration▲3952.67
[PDF]A Claim Is Not a Measurement: Compliance Claims Change What LLM Evaluators Verify and Accept▲3.0k2.33
[PDF]Same Verdict, Different Check Values: What Field Order Changes in a Structured LLM Judge▼1.2k1.67
[PDF]Prompt Lottery in LLM-As-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing▼5.8k2.33
[PDF]From Judgment Quality to Downstream Utility: Rethinking LLM-as-a-Judge for Open-Ended Tasks▼1.2k1.67
[PDF]Two Asymmetries of LLM Self-Review: Family-Dependent Recall Gaps and Same-Model False-Positive Bias▲11.00
[PDF]What Can Be Corrected in LLM Judge Ratings? Identifiability, Measurement, and Targeted Adjustment▼4.3k2.00
[PDF]Benchmark Reliability: A controlled comparison of human preference, rubric scoring, and LLM judges on EnterpriseVAL▼4.3k2.00
[PDF]Vibrics: Unified Evaluation of Video Generation Pipelines with Request-Specific Rubrics▼4.3k2.00
[PDF]Quality Is Not One Thing: Auditing, Distilling, and Blending LLM-Judge Annotations for Pre-Training Data Selection▼1361.33
[PDF]Authorization and Endorsement Forgery in Multi-Agent Evaluation: Propagation and Defense▼4.3k2.00
[PDF]Beyond Problem-Solving: A Multi-Agent Framework and Pedagogically-Aligned Benchmark for Evaluating LLMs’ Educational Question Generation▼1361.33
[PDF]InEx: Intrinsic and Extrinsic Evidence for Trustworthy Evaluation of Latently Verifiable Tasks▲432.75
[PDF]BlameShift: Blame Integrity of Multi-Agent Failure Attribution under Ownership-Constrained Narrative Edits▼1361.33
[PDF]Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers▼5.8k2.33
Withdrawn or desk rejected (27)
[PDF]Compositional Coordination Confidence: Anytime-Valid Monitoring for Multi-Agent LLM TrajectoriesWithdrawn1.33
[PDF]How Much Do LLM-as-a-Judge Design Choices Matter? A Systematic Comparison of Prompt Designs, Rating Scales, and ModelsWithdrawn1.67