- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SCOPED for integrating multiple visual capabilities into a single VLM. it first trains capabilty-specific experts with RL, extracts textual skills from successful & failed expert trajectories. Then, it uses these skills to condition the experts during multi-teacher on-policy distillation. The student itself does not use the skills at inference time. Eight multimodal benchmarks and Qwen3-VL-4B/8B are used in experiments. SCOPED improves over the corresponding backbone and mixed-capability RL. Additionally, the ablation studies and analysis verify the effectiveness of each component of SCOPED.
Critical strengths
- The experiments are fairly extensive. The paper evaluates across eight benchmarks and two model sales, including useful analysis of gradient interference, expert capability retention, trajectory consistency and visual attention.
- The paper also provides reasonable ablations separating the effects of expert specialization, on-policy distillation and skill augmentation.
Critical weaknesses
I see some practical value in the overall engineering pipeline, but I do not think the current methodological contribution is substantial enough for a full paper.
-
The core pipeline largely combines two existing ideas, i.e., 1) training capability-specific experts and consolidating them through multi-teacher on-policy distillation, as well as 2) using trajectory-derived skills as privileged context for teacher supervision. Both ingredients are already discussed in the paper's related work. I do not see a substantially new distillation mechanism beyond this combination.
-
Furthermore, the method is almost modality-agnostic. I am not sure what is specifically visual about this method. Frankly speaking, the same approache could be applied to almost any modality or task. Vision seems more like the application setting here, rather than something the method is actually designed around. The ablation studies also suggest this point. The most of the gain already comes from multi-expert OPD. On the 8B model, SCOPED without skill augmentation reaches 72.39 average score, while full SCOPED reaches 73.13.
Questions for authors
See above weaknesses.
3 comments
Dear Reviewer,
Thank you again for your valuable feedback. We hope that our responses have addressed your concerns and would greatly appreciate any further thoughts you may have.
We would be happy to provide additional clarification if needed.
Thank you for your time and consideration.
Thank you for the response, but my main concerns remain unresolved. First, I have pointed this out as a weakness in my review, and your response merely repeats the same weakness. The response does not provide any new methodological depth. Also, the "response to W2" is completely self-contradictory. If this paper intends to build a general framework, the method should be designed and evaluated across modalities accordingly. If not, this paper should provide genuine vision-specific insights and designs. Claiming generality here as the response for lacking visual specificity is rather unconvincing. Last, simply repeating the numbers does not change the fact.
Thus, I do not think this paper is ready for acceptance at its current stage. Maintaining my current score without lowering it further is my bottom line;
We thank the reviewer for recognizing the extensive experiments and component analyses. We further clarify the methodological contribution and scope of SCOPED.
Response to W1 – Methodological Contribution Beyond Existing Distillation Frameworks
SCOPED addresses heterogeneous capability integration by combining independent RL, capability-specific experience abstraction, and skill-conditioned multi-teacher distillation. Unlike standard MOPD, which directly transfers expert predictive distributions, SCOPED extracts reusable guidance from successful and failed expert trajectories and uses it as privileged information to condition the corresponding teachers along student-generated on-policy trajectories.
Compared with Skill-SD and related approaches, our focus is on integrating multiple independently RL-optimized experts with heterogeneous reward objectives into a unified student, rather than single-model self-distillation. This design enables capability-specific guidance to enhance expert supervision without requiring skills or expert routing during inference.
Response to W2 – Visual Specificity and Generality
SCOPED is not inherently restricted to visual tasks, which also highlights its potential generality. We choose multimodal visual understanding because its heterogeneous capabilities provide a representative setting for studying optimization interference and knowledge integration.
Specifically, perception, OCR and chart understanding, symbolic reasoning, and multi-image reasoning involve different input structures, reward functions, and reasoning requirements. These differences motivate capability-specific expert learning and experience abstraction, followed by unified capability integration.
Our experiments across these four capability groups demonstrate that SCOPED effectively preserves complementary expertise in a unified VLM. The framework also has the potential to generalize to language-only models and other modalities, which we consider a promising direction for future investigation.
Response to W2 – Incremental Benefits of Skill Augmentation
Skill conditioning provides capability-specific guidance exclusively to the teachers during distillation, while the unified student requires neither skills nor expert routing at inference time.
Under the same expert and distillation configurations, SCOPED improves upon MOPD by +0.74 and +0.45 on the 8B and 4B models, respectively. Furthermore, amplitude retention and directional alignment analyses show that SCOPED better preserves specialized expert behaviors. These results support the effectiveness of skill conditioning in improving heterogeneous knowledge transfer beyond standard multi-expert distillation.