- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This controlled empirical study challenges the assumption that higher source-domain accuracy ensures superior cross-domain transfer when adapting vision foundation models to imaging sonar. The authors evaluate feature-adaptation granularities from token-level scalar scaling to channel-wise transformations. Experiments reveal that fine-grained adaptations improve source accuracy but degrade sonar transfer performance compared to coarse scalar corrections. Further evaluations across multiple backbones and source domains demonstrate that preferred granularities depend heavily on the setting and originate from joint backbone-correction optimization rather than isolated output constraints.
Critical strengths
The paper critically challenges the widespread empirical assumption in cross-modal transfer that higher source-domain accuracy inevitably translates into superior downstream performance. By designing a bounded feature-correction framework that rigorously controls the gain range, initialization, and training protocol, the study provides counter-intuitive and valuable empirical evidence on how adaptation granularity governs representation transfer to imaging sonar.
The empirical evaluation is executed with thoroughness across a matrix of three backbones and three source domains, accompanied by carefully designed geometry and regularization analyses. Furthermore, the authors maintain high academic rigor by strictly distinguishing between probe-seed variance and training-seed uncertainty, refraining from overclaiming the universality of scalar adaptation, and transparently detailing the boundaries of their conclusions.
Critical weaknesses
While the study evaluates massive visual encoders such as the 576M-parameter Qwen backbone, the downstream sonar target task contains only 645 test images in total. On such a tiny test set, a prediction change on a single image alters the accuracy by approximately 0.155 percentage points. Given that many observed margins between adaptation granularities are narrow, the statistical power is inherently weak, making it difficult to distinguish genuine representation benefits from sampling noise or random test-set fluctuations.
Despite constructing a multi-backbone and multi-source matrix, all downstream evaluations ultimately collapse onto this single, constrained 12-class turntable sonar dataset. Without cross-validation on larger-scale, multi-view, or in-the-wild sonar benchmarks
Questions for authors
see the Critical Weaknesses
4 comments
Response to Reviewer Ha4R(Q2)
Thank you for this comment. We address this concern with two additional independent target benchmarks: T1 and T2. T1 comprises independent data collected with a different 600 kHz imaging sonar in a separate acquisition campaign, with object-disjoint splits. T2 is a fully in-the-wild, multi-view free-swimming survey collected using a 455 kHz sonar under uncontrolled backgrounds. Both benchmarks retain the same 12 debris classes, which enables direct comparison of adaptation granularity, with independent objects as listed in Table R5a. We evaluate the same source-trained encoders (Plain / Scalar / Grouped / Channel) under fixed probe protocols: no target fine-tuning, and no method redesign informed by test data. All configurations were frozen before final evaluation. Two key patterns are consistently observed: the scalar correction maintains a clear advantage over plain fine-tuning on both targets (+2.6 [1.8, 3.4] on T1; +2.3 [1.5, 3.1] on T2); meanwhile, the optimal adaptation granularity shifts across target environments. On T1, scalar correction outperforms channel-wise correction (+0.9 [0.3, 1.5]), while the difference is inconclusive on T2 (−0.3 [−0.9, 0.3]). This confirms that the configuration preferred on the source domain does not always transfer best to a new target. These two benchmarks extend our evaluation far beyond the original constrained turntable setting.
Finally, we greatly appreciate your comments, which help us polish the details and descriptions of our manuscript. We will add these results and discussions in the revised version.
Thank you for your rebuttal. However, I do not have enough experience to judge the quality of this work, so I have decided to maintain my original score.
Response to Reviwer Ha4R
We sincerely appreciate your careful review and valuable comments. We are also grateful for the time and effort you devoted to evaluating our work.We fully understand your position. If you have any further questions or clarifications that we can provide to assist you or the area chair in the evaluation, please feel free to let us know.
Response to Reviewer Ha4R(Q1)
Thank you for this comment. We have supplementary evaluation results on T1 (2,340 test images) and T2 (3,105 test images), which were completed before submission but omitted from the main manuscript due to space constraints. Specifically, scalar correction outperforms channel correction on T1, while the difference on T2 is inconclusive.
For the original target split, we report paired effect estimates and confidence intervals, properly accounting for repeated predictions on the same test units instead of treating them as independent observations. Since this original benchmark was used during exploratory development, its results serve as developmental evidence rather than an independent confirmatory assessment. We use resampling units that respect underlying acquisition dependencies and clearly separate robust supported effects from unresolved differences in the revised manuscript.
Table R8b. Principal comparisons on the original target with five paired encoder seeds (mean ± SD, LP %).
Finally, we greatly appreciate your comments, which help us polish the details and descriptions of our manuscript. We will add these results and discussions in the revised version.