- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DualFlow, a dual-anchor flow-matching framework for few-shot and few-shot class-incremental adaptation of vision-language models. Instead of transporting visual features only toward textual class prototypes, DualFlow retains both textual prototypes and support-derived visual prototypes as complementary endpoints. A shared flow backbone with two endpoint-specific heads learns the corresponding velocity fields, which are combined using a support-derived reliability coefficient. The same formulation is extended to FSCIL by keeping the VLM encoders fixed, appending new textual and visual prototypes as classes arrive, and continually updating only the lightweight flow network. Experiments on 11 few-shot benchmarks and three FSCIL benchmarks show consistent improvements over text-only flow adaptation and competitive performance against existing peft and FSCIL methods.
Critical strengths
- The paper clearly identifies that textual prototypes are not always optimal transport endpoints, while visual prototypes can be noisy under limited supervision. Preserving both signals rather than committing to either one is well motivated, and the ablations show that their relative usefulness varies substantially across datasets and shot settings.
- DualFlow is evaluated across multiple shot settings, peft backbones, five random support-set seeds, and three FSCIL benchmarks. The component ablations also distinguish adaptive fusion from simply averaging the two anchors or training a single flow toward a fused endpoint.
Critical weaknesses
- The theoretical analysis derives an optimal fusion coefficient that depends on the textual risk, visual risk, and their cross-error term. However, the implemented coefficient is simply based on the ratio of estimated downside risks and ignores this cross-correlation term. So the theory establishes the potential benefit of anchor fusion, but does not directly justify the particular estimator used by DualFlow.
- Although old prototypes and VLM encoders are frozen, the shared velocity network is continually updated using only the current-session data. Thus, the transformation applied to old-class queries can still change. Moreover, the fusion coefficient is estimated once from the base session and reused for all future classes, despite potentially different text/visual reliability in later sessions. More explicit old-class forgetting analysis would strengthen the continual-learning claim.
Questions for authors
see weaknesses
Response to Reviewer 776h
We thank the reviewer for recognizing the well-motivated dual-anchor design and comprehensive evaluation and ablation studies. Our detailed responses to the listed concerns are provided below, and the corresponding changes have been incorporated into the revised manuscript.
We thank the reviewer for this thoughtful comment. Sec. 4.2 establishes that complementary textual and visual anchors can yield a more accurate estimate of the ideal class prototype. The oracle optimal coefficient is
α⋆=clip[0,1](RT+RV−2CRT−C),
where RT,RV denote endpoint estimation risks and C is their cross-error moment. As derived in Appendix A1.3, when C=0, this reduces to RT/(RT+RV), motivating the relative-reliability weighting principle.
In practice, ideal class centers are inestimable, making both endpoint risks and their cross-error moment hard to estimate reliably under few-shot setting. In particular, estimating C requires characterizing the correlation between textual and visual estimation errors, which is challenging with limited support samples. We therefore adopt the simplified relative-risk formulation as a practical approximation, rather than explicitly estimating C. We use negative classification margins as observable reliability proxies, consistent with prior work using margins to characterize classification uncertainty (Guo et al., ICML 2026, Sample Margin-Aware Recalibration of Temperature Scaling).
Empirically, Tab. A3 validates our adaptive weighting against fixed-weight fusion, improving the 1-shot difficult/easy averages from 47.2/72.1 to 56.6/82.1, and we now move this analysis from Appendix to the main paper in Tab.3 for clearer analysis.
To further validate our coefficient, we compare the support-estimated α with the best-performing α selected through dataset-specific grid search under 16-shot CLIP ViT-B/16. The former is computed directly from support samples, whereas the latter is selected post hoc based on test accuracy. We report the results below, more analysis are provided in Appendix A3.4.
Across all 11 datasets, the estimated coefficients differ from the grid-selected values by only 0.055 on average, with differences below 0.1 on 9 of 11 datasets. The test-selected grid-search results serve solely as a diagnostic reference.
These findings demonstrate that our practical estimator achieves performance close to grid-selected fusion weights, while the theoretical analysis establishes the potential benefit of complementary anchor fusion. We have clarified this distinction in Secs. 4.2–4.3.
We provide a base-class forgetting analysis to directly examine whether updating the shared velocity network affects previously learned classes. Specifically, we keep both the base-class test samples in the base session and candidate classes fixed across sessions, and measure the base-to-final accuracy drop solely on base samples, reporting Δ=Acc0−Accfinal.
DualFlow exhibits substantially smaller accuracy drops across all three benchmarks, demonstrating less old-class forgetting despite continually updating the velocity network with new-class data. We have incorporated this analysis into the main paper in Fig.3, with the detailed protocol and additional analysis provided in Appendix A3.6.
Regarding the fusion coefficient, our design balances stability and adaptivity. The data-rich base session provides a more reliable estimate of relative textual and visual anchor reliability than individual few-shot incremental sessions. Re-estimating the coefficient at each session could introduce calibration fluctuations affecting both velocity composition and classifier anchors for previously learned classes. We therefore retain the base-calibrated coefficient while allowing the velocity fields to adapt to incoming categories. Although this choice promotes consistent fusion geometry, we do not assume that the coefficient remains optimal for all future classes, session-wise recalibration remains a possible extension.