- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DATAVALVE, a framework that selects visual instruction-tuning data during model training. It contains a lightweight router and an online LoRA-influence gate, which prioritizes currently useful samples and suppresses redundant ones. Experiments show that it can achieve 98.4% with 20% of the data.
Critical strengths
- The paper addresses the limitations of traditional select-then-train paradigms by introducing an adaptive data selection framework that accounts for evolving sample utility during multimodal instruction tuning.
- DataValve integrates lightweight routing into the training process, avoiding an additional full-pool target-model scoring stage and achieving a favorable trade-off between computational efficiency and downstream performance.
- The combination of golden-set loss feedback and LoRA-based gradient information provides an interesting approach to adaptive sample selection, mitigating the over-selection of high-loss data sources without explicit diversity regularization.
- The method achieves 98.6% of full-data performance using only a 20% training data budget, with additional experiments demonstrating its applicability across different datasets and model architectures.
Critical weaknesses
- The proposed framework mainly combines existing techniques, including lightweight routing, held-out loss feedback, gradient-based reward modulation, and policy-gradient optimization. The core technical contribution appears largely heuristic.
- Golden-set loss changes are measured after multiple model updates, making it difficult to attribute performance improvements to individual selected batches. This may introduce noisy or misleading rewards during router optimization.
- Gradient energy does not necessarily reflect actual sample utility or redundancy. The paper lacks sufficient theoretical and empirical evidence establishing a reliable relationship between the proposed gradient-based gate and marginal training contributions.
- The paper lacks comparisons between frozen and continuously updated routers, as well as systematic evaluations against simpler gradient-based reward alternatives. These experiments are important for validating the necessity and effectiveness of the proposed components.
- The claimed "selecting-while-training framework" has been widely investigated by dynamic data selection methods. Thus, the novelty degrades.
Questions for authors
See weakness.