NeurIPS 2026 reviews are up: reviews, scores, rebuttals and meta-reviews for 7,877 papers. See the highest rated
acceptodds: the papers of ICLR 2027
354 results for “keyword:"pretraining"” in ICLR 2027. 64 withdrawn or desk rejected listed apart. clearsort:relevanceratingnewestmost read
[PDF]Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings▼4.3k2.00
[PDF]UMM-JEPA: Generative Pretraining via Masked Next-Scale Representation Prediction for Unified Multimodal Models▲432.75
[PDF]Consero: Knowledge-Informed Prediction Framework with Language and Tabular Foundation Models▲3.0k2.33
[PDF]Synthetic to SPX: Model-Based Pre-Training for Diffusion Models of Financial Time Series▼1361.33
[PDF]Structure, Dimensionality, and Distribution Shape: What Makes Pretraining Data Transferable, and Why the Input Pipeline Decides Which▼5.8k2.33
[PDF]Pretraining Shapes Spectral Structure: Architecture- and Strategy-Conditional Prediction of OOD Robustness in Foundation Models▼1361.33
[PDF]From Minutes to Days: Scaling Intracranial Speech Decoding with Supervised Pretraining▼4.3k2.00
[PDF]Corrupted Inputs Make Dense Supervision Informative for Zero-Shot Variant Scoring: A Controlled Factorial Study of Compact Protein Encoders▼5.4k1.50
[PDF]Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining▼1.2k1.67
[PDF]DANCE: Domain-Aware Network-Coupling Encoder for Coordinate-Free Intracranial EEG Representation Learning▲3.0k2.33
[PDF]The No Free Lunch of Self-Supervised Brain Models: Behavior Prediction, Learning Objective, and Data▲9.2k2.67
[PDF]Pretrain Once, Deploy Many Times: Frequency-Aware Memory for Training-Free Anomaly Detection on Unseen Machines▼5.8k2.33
[PDF]MolRIME: Reciprocal Innovation-driven Multimodal Exchange for Molecular Representation Learning▲6.1k2.00
[PDF]MARVEL: Masked Autoregressive Visual Understanding and Generation for Spectral Remote Sensing▲3.0k2.33
Withdrawn or desk rejected (64)
[PDF]The Variance Brain Foundation Models Forgot: A Third-Order Basis for Predicting Individual DifferencesWithdrawn1.67
[PDF]Learning to Be Fooled: pretraining grows knowledge but keeps the scar of framing susceptibilityDesk rejected
[PDF]Input Representations Meet Pretraining Objectives: A Controlled Study of Generative EHR Foundation ModelsWithdrawn1.67
[PDF]Scene-Graph Molmo: Adding Structure to Pretraining Yields Strong Vision-Language ModelsWithdrawn1.75