- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates the reuse of LoRA from the original multi-step model in a few-step distilled video model. The authors point out that geometric compatibility in the weight space is insufficient to predict the functional performance after transfer, and propose DART. LoRA is transferred via a low-rank distillation bridge and singular subspace alignment; then, channel responses are estimated using paired forward computations to solve a regularized coefficient calibration problem. The conversion requires neither the original training video nor backpropagation, and the final output can be deployed as a fixed LoRA.
Critical strengths
-
The motivation has practical value. Few-step distillation may compromise the reusability of existing LoRA models, and retraining requires data and computational resources. This paper proposes a transformation method to address this deployment challenge, and the motivation for its application is clear.
-
The methods are designed to complement each other in a logical manner. Coordinate translation adjusts the available update directions, while response calibration adjusts the relative contributions of these directions.
Critical weaknesses
-
There is no direct validation between thebridge-based coordinate transport and the deployment of the target model. Appendix D.7 analyzes the impact of residual drift but does not quantify the actual response error.
-
Performance gains vary across different LoRAs. Table 13 shows that DART-F does not improve performance metrics on all LoRAs. For example, the FGR of LoRA 07 drops from 0.3397 (when directly reused) to 0.2780; while LoRA 01, 03, and 06 showed some improvement but remained negative. Therefore, the improvement in average metrics is insufficient to demonstrate that the method can consistently preserve performance across various LoRA variants. We recommend analyzing these cases of failure or degradation to clarify the method’s applicability boundaries.
Questions for authors
See weakness.