NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
433 results for “keyword:"on policy distillation"” in ICLR 2027. 71 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]PACE: Prefix-Anchored Calibration with Adaptive Segmentation for On-Policy Distillation▲3952.67
[PDF]How Should Teachers Be Prepared? RL on Student-Induced States for On-Policy Distillation▼4.5k2.67
[PDF]Learning When Evidence-Sensitive Guidance Helps: Calibrating Counterfactual On-Policy Distillation for Memory-Grounded Question Answering▼4.3k2.00
[PDF]Not All Tokens Should Update the Same Parameters: Prefix-Conditioned Gradient Routing for On-Policy Distillation▼1.2k3.00
[PDF]Cover the Teacher, Stay Close to the Student: Mode-Covering Trust Regions for On-Policy Distillation▼1361.33
[PDF]Track-OPD: Learning from Future Consequences for Multi-Object Tracking via On-Policy Distillation▼4.5k2.67
[PDF]DuoOPD: Learning from Joint Teacher–Student Outcomes for Multi-Task On-Policy Distillation▲5.4k3.00
[PDF]Compress to Improve: Reclaiming Output Budget from On-Policy Distillation for Stronger Reasoning▼1.2k1.67
[PDF]Distillation with Errors: Efficient On-Policy Distillation via Sparse Unbiased Gradient Estimation▼1611.50
[PDF]OPQAD: Recovering Capability under KV-Cache Quantization via On-Policy Quantization-Aware Distillation▲5103.00
[PDF]Open-MOPD: Diagnosing and fixing capability im-balance in multi-teacher on-policy distillation▲5.7k2.00
[PDF]Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation▼4.5k2.67
[PDF]Trapped by Their Own Rollouts: Understanding Aggregation–Rollout Feedback in Federated On-Policy Distillation▲5.4k3.00
[PDF]Align and Expand: Recovering Dense Supervision for Cross-Tokenizer On-Policy Distillation▼4.5k2.25
[PDF]TrajPD: Constructing Trajectory-Aware Targets for On-Policy Distillation in Tool-Integrated Reasoning▲8.9k2.75
[PDF]When to Use the Solution: Preserving Exploration in On-Policy Self-Distillation for Reasoning Models▼4.3k2.00
[PDF]Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models▲3952.67
[PDF]EnergyOPD: Energy-Based On-Policy Distillation for Stable and Generalizable Knowledge Transfer▲3.0k2.33
[PDF]Constraint-Decoupled On-Policy Distillation for Multi-Constraint Instruction Following▼1.2k1.67
[PDF]Understanding On-Policy Distillation: A Mechanistic Interpretability Perspective via Sparse Crosscoders▲5103.00
[PDF]Resolvable-Effect Accounting for Tool-Calling Agents: Reward Bias and Evaluation Resolution▲11.00
Withdrawn or desk rejected (71)
[PDF]Closing the Self-Teaching Loop for Open-Ended Generation: Sibling-Conditioned Distillation Meets Self-VerificationWithdrawn1.67
[PDF]CACO: Cost-Aware Dynamic Caching with On-Policy Distillation for Accelerating Diffusion ModelsWithdrawn1.67