- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes BAT, a speech separation architecture that separates a noisy AC-mixture speech signal between the wearer and an interlocutor using a synchronized bone-conduction (BC) reference from the wearer. The AC and BC input are encoded by a shared audio encoder. Then, the cross-band fusion module uses BC features and local cross-sensor cues to condition the separator. The decoder adapts complex-mask bounds during reconstruction.
A new dataset named LS-Bone is also introduced. It consists of a set of paired English AC–BC recordings, and construct the two-speaker VibroMix benchmark using the LS-Bone, a Mandarin AC–BC speech corpus, and environmental noise from WHAM! and DNS. It also creates an evaluation set VibroMix-2Mix, on which BAT reports 17.3 dB mean SI-SNR improvement, 2.6 dB above a two-output adaptation of Robust Fusion. Ablation studies are performed, supporting the contributions of the proposed fusion and decoder components.
Critical strengths
-
Strong empirical results on the VibroMix-2Mix. BAT improves mean SI-SNRi by 2.6 dB over the strongest reported two-output BC-guided baseline, with good recovery of both the guided and unguided speakers.
-
Ablation studies are performed on the fusion operators and mask bounds. The results show the effectiveness of the proposed choices.
Critical weaknesses
-
Missing information regarding the dataset construction. For example, the split of the underlying recordings is unspecified. The paper gives mixture-level train, development, and test counts but does not clearly state whether the original paired AC–BC recordings are disjoint across splits. Reusing a recording in different mixtures could make the test results unreliable.
-
Some baseline comparisons need qualification. Blind separators receive no BC cue identifying the wearer, yet their outputs are scored in fixed guided–unguided order without permutation matching. Additionally, the implementation of Robust Fusion adaptation (the main baseline) was not described in enough detail.
Questions for authors
-
Were the original AC–BC recording pairs disjoint across training, development, and test, before mixtures were generated? Were speakers disjoint?
-
According to Appendix C.2, the evaluation assumes that the guided speaker comes first. How do the blind-separator results change with permutation-invariant matching?
-
What architectural, loss, and training changes were made to adapt Robust Fusion for two-output?
3 comments
I thank the authors for the rebuttal. The clarification regarding the speaker-disjoint and recording-disjoint dataset splits resolves my concern about potential data leakage. I am also satisfied with the explanation of the permutation-invariant evaluation protocol for blind separators and the implementation and training details of the two-output adaptation of Robust Fusion.
I appreciate that these clarifications have been incorporated into the revised manuscript, improving its clarity and reproducibility. My original concerns have been addressed, and I have no further questions.
Dear Reviewer,
Thank you very much for your careful review and for taking the time to assess our rebuttal. We also appreciate your recognition of our work’s contributions. We sincerely thank you for confirming that our revisions have addressed your concerns. Your constructive feedback has helped us improve the clarity and reproducibility of our paper.
Kind regards,
The Authors
Response to Reviewer iYA5
We sincerely thank the reviewer for recognizing BAT's strong empirical results on VibroMix-2Mix, its recovery of both guided and unguided speech, and the ablation evidence supporting the proposed fusion and decoder components. We respond below.
[W1] [Q1] The recording-level dataset split is unspecified, raising concerns about recording reuse across splits. Were the original AC–BC recording pairs and speakers disjoint across training, development, and test before mixture generation?
Response. The training, validation, and test sets are fully speaker-disjoint. Each speaker’s original paired AC–BC recordings are confined to that speaker’s split, so the same recording pair is not reused across splits when constructing mixtures. We have clarified this in the “Dataset splits” paragraph of Appendix B.2, with the additions marked in blue.
[W2] [Q2] Blind separators are scored in a fixed guided–unguided order without BC wearer-identification cues or permutation matching. How do their results change under permutation-invariant matching?
Response. The blind baselines use permutation-invariant training (PIT), and the reported scores already use permutation-invariant output–reference matching during evaluation. Their values therefore remain unchanged. The fixed guided–unguided order specifies the clean references for source-wise statistics; predictions are matched to these references before aggregation. We have revised this passage in Appendix C.2 to explicitly state that permutation-invariant matching is used for metric computation, with the revisions marked in blue.
[W2] [Q3] The two-output adaptation of Robust Fusion is insufficiently described. What architectural, loss-function, and training changes were made?
Response. For the two-output comparison in Table 1, Robust Fusion was adapted by modifying only its output layer to estimate both wearer and interlocutor speech, matching BAT’s two-output setting. The remaining network architecture was retained. All models in this comparison used the same training framework and negative SNR loss, averaged over the two outputs. These adaptation and training details are documented in Appendix C.1, with the additions marked in blue.