- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors propose a foundation model for wearable A-mode ultrasound. The model is pre-trained on ~24.7M unlabeled scans from five platforms, including a newly collected multi-site dataset. They propose a frequency-aware multi-tokenizer that adjusts the patch size according to the sampling frequency. Later linear projections map these patches into token sequences with the same embedding dimension. The model is pre-trained through masked reconstruction, processing each channel independently with a shared encoder. Experiments on different ultrasound benchmarks show improvements over the same architecture trained from scratch on all eight tasks. Fine-tuning with 40% of the labeled training data also outperforms training from scratch with the full dataset on all eight tasks.
Critical strengths
- The paper introduces a foundation model for wearable A-mode ultrasound through large-scale pre-training.
- The frequency-aware tokenizer reflects the relationship between sampling frequency and physical depth in ultrasound. The design is simple and easy to understand.
- The paper provides a clear and reusable framework for pre-training and evaluating A-mode ultrasound models.
Critical weaknesses
- The simple method is a strength. However, the paper lacks analysis of why its main design choices work better than other alternatives. Such comparisons are particularly important for a work that aims to provide a foundation for future research in this modality.
- The frequency-aware tokenizer is an important component, but the paper does not report comparisons with a fixed patch size across sampling frequencies or with resampling all signals to a common sampling frequency. These comparisons would help clarify the benefit of the proposed tokenizer over simpler alternatives and its contribution to the reported improvements.
- The choices of masked reconstruction and a shared encoder are also not sufficiently examined. Comparisons with other pre-training objectives (e.g., contrastive learning) would help explain the role of reconstruction. Similarly, comparisons with channel-specific encoders, or with pre-training that jointly uses multiple channels, would help clarify the benefits of shared weights.
- As described in the limitations, the evaluation is limited to subject-specific models. Evaluating transfer to unseen users would help assess how well the pre-trained model generalizes across users.
Questions for authors
The release of the code, checkpoints, and dataset would be important. Clear description of how to access and replicate the existing results would be important for future comparisons.
4 comments
Thank you for your detailed response. I really appreciate the clarifications regarding the scope of the work and the commitment to releasing the code and data. I also look forward to seeing the contrastive learning results, which I believe will be helpful. However, I still have one critical concern. If the simpler alternatives perform as well as or better than the original frequency-aware multi-tokenizer, and the main method is now being replaced, I feel this is a substantial change for a rebuttal. I considered the frequency-aware tokenizer to be one of the key technical contributions of the original submission. Therefore, I would like to ask whether the authors consider the main contribution of the work to have changed, and how they would position the novelty of the revised method. At this point, this concern makes it difficult for me to reconsider my original rating.
Reply to reviewer r5wY
We thank the reviewer for the follow-up and for engaging so closely with our work. We address the two questions directly.
The key contributions of the paper remain unchanged, and the additional experiments conducted during the rebuttal period strengthen them further. We position the novelty at the level of the modality and the framework, not of a single architectural component:
- The first foundation model for A-mode ultrasound (AUS), pre-trained on A-mode signals and evaluated for transfer across acquisition systems and downstream tasks.
- Heterogeneous pre-training across hardware platforms. Data from benchtop systems to wearable devices are combined into a single framework, and the approach applies from linear-array probes down to a single transducer.
- A systematic, controlled study of design choices. We compare input harmonization strategies (resampling vs frequency-aware multi-tokenizer vs interpolation), pre-processing strategies and pre-training objectives (masked reconstruction vs contrastive) under consistent conditions, including different pre-training corpus compositions. The contrastive comparison you were waiting for is complete: masked reconstruction is better than a wav2vec 2.0 objective on seven of the eight tasks after fine-tuning and on all eight with a frozen encoder (Appendix E.2, Table 12; numbers in our follow-up comment to all reviewers). Showing which choices matter, and that simple harmonization is sufficient and more robust, is a non-obvious result for this modality and a useful reference point for future work.
- Edge deployment of the pre-trained model, which is required for the wearable, low-power applications where AUS is most relevant. The model runs on a low-power microcontroller (160.5 ms and 12.7 mJ per scan), and we report its current rate limits.
The rebuttal experiments reinforce these contributions. The corpus-composition analysis (Section 4.6, Appendices D.3 and E.1) extends the systematic study and shows that the benefits of heterogeneous pre-training hold across corpus configurations and do not depend on a specialized input representation. The extended label-efficiency analysis, now including the CNN baseline (Figures 2 and 6), shows that the fine-tuned foundation model stays ahead of CNNs trained from scratch as training data increase. The contrastive results (Appendix E.2) further support our choice of masked reconstruction as the pre-training objective.
What changed is one component of the architecture: the input harmonization strategy. Following experiments requested by the reviewers, the frequency-aware multi-tokenizer has been replaced by a simpler resampling-based approach. We understand why the reviewer saw the tokenizer as a key contribution, given its prominence in the original submission. However, it was one way of handling heterogeneous inputs, in service of the main goal of building the first foundation model for AUS.
To provide more details, with full-corpus pre-training, the multi-tokenizer and resampling perform on par (Appendix E.1, Table 11): on this setting alone, we could have kept the original method as the reference implementation. However, when WULPUS data are excluded from pre-training, resampling outperforms the multi-tokenizer (Figure 7; Appendix E.1, "Transfer to a platform absent from pre-training"). The multi-tokenizer therefore offers no advantage in either configuration, while resampling is equal or better in both. We adopted resampling as the reference configuration and report both results openly. This decision was driven entirely by results: presenting the configuration best supported by the evidence, instead of keeping the original design because it was already in the submission, is in our view the scientifically correct choice.
This also resolves a question the original submission left open: since simple resampling is sufficient, the gains come from AUS pre-training and the data, not from a specialized input representation. We believe this strengthens the paper's main claim.
We will release all code, models and pipelines needed to reproduce the evaluations in the paper. Together with the systematic comparison of design choices, we believe this provides a strong, reproducible baseline and a shared toolchain that the community can build on, so that more specialized methods for AUS can be developed and compared under consistent conditions.
Again, I really appreciate your response. I appreciate the additional experiments and agree that establishing a foundation model for a new modality is valuable, especially in our field. However, my main concern remains. I believe that an important research contribution in developing foundation models for new modalities is identifying and addressing the unique challenges of those modalities. The frequency-aware tokenizer was, to me, the most distinctive technical contribution in this regard. Given that simpler, existing techniques perform equally well or better, I am not yet convinced that the work provides sufficient new insights beyond demonstrating that a combination of established techniques works well for A-mode ultrasound. While I appreciate the systematic analysis and the value of providing a strong baseline, this concern remains insufficiently addressed for me to revise my rating.
Reply to reviewer r5wy
We thank the reviewer for recognizing the value of large-scale AUS pre-training and the reusable framework. We agree that understanding the contribution of individual design choices is essential for informing future research.
We address the specific weaknesses below:
1. Frequency-aware tokenization vs simpler alternatives
This is reported in “Applicable to all reviewer - Input harmonization strategies”
Following your suggestion, we compared the frequency-aware multi-tokenizer with two simpler alternatives: resampling all signals to a common 20 MHz grid, and interpolating each scan to 800 samples, both followed by a single tokenizer with a fixed patch size. With the full corpus, the three perform equivalently after fine-tuning, so frequency-dependent routing gives no advantage. It is also the weakest option when a sampling rate is absent from pre-training: with the 8 MHz WULPUS data held out, hand-pose accuracy is 67.3% against 70.4% for resampling. We therefore replaced it with a single tokenizer on a common 20 MHz grid, which keeps a fixed physical depth of 0.308 mm per token on every platform (Appendix D.1, Table 11).
2. Contribution of masked reconstruction and comparison with contrastive approaches.
This is reported in: “Applicable to all reviewer - Extended the ablation studies with different pre-training objectives”
We added a wav2vec-inspired contrastive pre-training comparison using the same backbone as the main model, corpus and downstream evaluation protocols (Appendix D.2, Table 12). This tests whether reconstructing echo waveforms or discriminating latent representations yields more useful features for AUS tasks. The downstream evaluation is still running; we will report the results in a follow-up comment.
3. Benefit of shared channel encoding
Shared, independent encoding allows pre-training across systems with different channel counts and configurations without requiring channel correspondence between datasets (§3.3). This is the design rationale; we agree that it does not establish superiority over channel-specific or jointly trained multichannel encoders.
We added a comparison of CNN fusion and a flatten-plus-linear readout to examine how independently encoded channels should be combined (Appendix D, Table 13). This comparison is still running with the updated main model, and we will report it in a follow-up comment. It isolates downstream aggregation, not encoder sharing. Channel-specific encoders and joint multichannel pre-training remain untested, and we retain them as future directions (§5). This is also reported in: “Applicable to all reviewer - Extended the ablation studies with different pre-training objectives”
4. Does the model generalize to unseen users?
Our evaluation is subject-specific, following the reference benchmark protocols (§4.2; Appendix C.1), and therefore does not establish unseen-user generalization.
The new WULPUS-exclusion experiment (also reported in Applicable to all reviewers- Leave one platform, dataset and anatomy out experiments) provides complementary evidence of transfer to an unseen platform and forearm anatomy: PosePos-USVR hand-pose balanced accuracy is 70.4%, compared with 75.5% when WULPUS is included, and HWR-23DoF RMSE is 13.17° versus 13.26° (§4.6; Table 9). We explicitly distinguish these results from unseen-user transfer, which remains future work.
5. How can the code, checkpoints and data be accessed and the results reproduced?
The code and model checkpoints will be made publicly available after review to preserve anonymity. We’ll also open-source the WULPUS Multi-site dataset specifically collected for this work. We believe this open-sourcing of both code, model checkpoints, and data will help the community and foster more subsequent research.