acceptodds
Under review as a conference paper at ICLR 2027

Measure Before Reuse: Checkpoint Deltas as Post-Training Routing Signals

Abstract

Open-model ecosystems increasingly require users to choose among post-training actions before the relevant evaluations are known: accept a new checkpoint or adapter, search over merges, run targeted regression tests, reuse a prior capability delta , or avoid reuse. Existing delta methods mainly consume checkpoint deltas as construction objects. We argue that they should first be measured as data-free routing signals. Our two-stage workflow compares a prior capability delta with an update delta : Stage I uses checkpoint geometry alone to route to an action family, while Stage II uses benchmark deltas and sample-wise forgetting/backward-transfer transitions to confirm, revise, or reject candidates within that family. The geometry combines a norm ratio for displacement risk with module-level alignment for directional context. Across 20 post-training variants in our suite, norm ratio is the strongest coarse risk indicator, MLP and attention alignment add useful directionality, and global alignment does not. Case studies route a weak-conflict S1 regime to merge search, an adverse S2 regime away from prior reuse, and a statistically non-null but practically near-null SC LoRA case to targeted evaluation. In a fixed-candidate, branch-level routing study, geometry-guided action-family routing reaches mean Overall after Stage-II evaluation, compared with for always-prior and for never-prior. This is branch-level evidence over precomputed candidates, not prospective intervention selection or evaluation-cost reduction. Checkpoint deltas are evidence before they are ingredients.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.