acceptodds
Under review as a conference paper at ICLR 2027

From Decomposition to Integration: Stage-Specialized On-Policy Distillation for Video Diagnosis

Abstract

Fine-grained video diagnosis requires identifying the relevant subject, discovering subtle differences, and deciding which differences constitute a defect. We present a framework that turns these interdependent capabilities into structured supervision and integrates them within one model. A multipass annotation pipeline decomposes reference-conditioned diagnosis into Subject Binding, Multidimensional Comparison, and Issue Filtering, producing compact traces that connect visual evidence to diagnostic decisions. We then introduce Stage-Specialized On-Policy Distillation (Stage OPD): the student generates a complete trajectory, and each specialist provides feedback for its stage under the student's own preceding outputs. Annotated-trace replay supplies complementary supervision for content, stage transitions, and diagnostic decisions. With 2,160 training traces, the resulting 9B student improves both precision and recall on a human-reviewed benchmark, raising issue-detection from 36.68% to 41.88%. The student exceeds a three-call SFT chain in and approaches the 27B reference within 0.31 points while retaining a single 9B model at inference. Overall, Stage OPD organizes specialized supervision through decomposition and integrates the resulting diagnostic capabilities into one model.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.