NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
354 results for “keyword:"pretraining"” in ICLR 2027. 64 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]PRECOCIAL: Pretraining with Code Curriculums via Iterative Search for Accelerated Learning▼4.3k2.00
[PDF]Revisiting the 16× Pretraining Compute Gap between Diffusion and Autoregressive Language Models▼4.3k2.00
[PDF]Hard, Not Rare: Human Item Difficulty, Not Concept Frequency, Orders Model Errors Across Professional Examinations▼5.8k2.33
[PDF]Predicting Where Recall Fails: The Fact Matters More Than the Entity in Black-Box Language Models▼1361.33
[PDF]Normalize the Update, Not the Weights: Efficient Loss Weighting for Multi-Objective Pretraining▲3.0k2.33
[PDF]Breaking the Black Box: An Architecture-Specialized Preconditioning Optimizer for Attention Mechanism▼4.3k2.00
[PDF]GMNO on MaxwellBench: Scaling Pretrained General Mesh Neural Operator Across Industrial-Standard Electromagnetism Simulations▲143.33
[PDF]FieldForge: A Pretraining and Post-Training Framework for Flow-Based Crystal Generation▼4.3k2.00
[PDF]Beyond Fact Frequency: Controlled Evidence on Expression Allocation and Factual Callability▼1.2k1.67
[PDF]Large Language Models as Tutors of Clinical Semantics for Learning Cardiac Representations▼4.5k2.67
[PDF]Capability Budgeting: Acquiring Mathematical Reasoning While Retaining Capabilities in Multilingual Continual Pretraining▼1.3k1.75
[PDF]Adaptive Multi-Objective Alignment in Pretraining Time-Series Foundation Models for EEG tasks▲13k2.33
[PDF]Privileged Guidance for Learning Fitness Landscape Representations from Limited Observations▼1.2k3.00
Withdrawn or desk rejected (64)
[PDF]The Variance Brain Foundation Models Forgot: A Third-Order Basis for Predicting Individual DifferencesWithdrawn1.67
[PDF]Learning to Be Fooled: pretraining grows knowledge but keeps the scar of framing susceptibilityDesk rejected
[PDF]Input Representations Meet Pretraining Objectives: A Controlled Study of Generative EHR Foundation ModelsWithdrawn1.67
[PDF]Scene-Graph Molmo: Adding Structure to Pretraining Yields Strong Vision-Language ModelsWithdrawn1.75