- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focus on deep fake detection in audio by presenting a LORA-like approach where high frequency constraint is injected in-between the orthonormal matrices of low rank. The authors (like others) assume that high frequencies better capture fake audio and hence a learnable unit within boosted frequencies will better learn those patterns. On tested benchmark this approach is SOTA.
Critical strengths
SOTA results on standard benchmark Interesting approach to combine LORA with spectral constraint
Critical weaknesses
While the author upgrade the conventional LORA with an additional middle layer, and indeed share the motivation from SUV, I still find it a bit unclear if indeed higher frequency are learned. Why would that approach will better or faster learn high frequency is kept un answered. I believe the authors should have at least shown that case on toy problem even if they cannot explain that analytically.
Questions for authors
Can you show the modified LORA learn faster data with high frequency (toy problem) ? Can you prove why?
4 comments
Frequency control
Following the clarification that frequency control is not the mechanism that drives the results, why is the spectral branch doing so? Beside evidence of improved results on the tested data, when will it most likely succeed? when will it fail?
Response to Reviewer 9wTR's comment on Why and When does the spectral branch Help
We thank the reviewer for the follow-up. We have added an analysis of the eight recent generators in Fig. 4 to support our explanation of what the spectral encoder detects and when this evidence helps or becomes unreliable (App. F.6, Figs. 13–14). Numbers refer to the revised PDF.
Why the spectral branch helps. The SSL-adaptation branch transforms the existing SSL representation, while the spectral branch supplies an additional representation computed directly from the short-time spectrum. This means that the spectral branch reads a generation artifact that SSL features do not expose. Our new analysis identifies a concrete sensitivity of this spectral encoder:
-
Sensitivity to fine spectral detail. Smoothing the power spectrum of genuine speech along frequency within 4–8 kHz progressively shifts its score toward generated speech. At approximately 300 Hz smoothing width, its mean score reaches the generated-speech mean. Randomizing phase alone leaves the score approximately unchanged (Fig. 13, right). This supports sensitivity to spectral detail removed by smoothing.
-
Evidence within speech. Using speech frames alone gives AUCs of 0.89–1.00 across the eight generators, matching or exceeding full-clip scoring. The most influential frequency band varies across generators (Fig. 13, left and middle).
-
Transfer beyond training generators. The encoder achieves this separation after training only on WaveFake. Together with the reduction in MLAAD EER from 24.67% without injection to 14.38% with injection (Tab. 19), these results support the value of complementary spectral evidence that SSL-only adaptation does not sufficiently exploit.
When it is most likely to help. We expect the largest benefit when an unseen generator leaves spectral differences detectable by the encoder, SSL-only detectors struggle to distinguish its speech, and the recording channel preserves those differences. Figures 4 and 11 support this expectation: SILO improves over the evaluated SSL-based baselines, including single-digit EER on MMS-TTS, Tacotron2, OverFlow, SpeechT5, and FastPitch.
When its benefit weakens or detection fails.
-
Severe acoustic degradation. Noise masks spectral detail and reverberation blurs it, as illustrated in Fig. 14. Correspondingly, 0 dB noise and 900 ms reverberation increase SILO’s EER by approximately 16–22 and 30–33 percentage points, respectively (Fig. 10).
-
Genuine speech affected by voice disorders. Pathological phonation can alter spectral structure in ways associated with synthesis (Figs. 7–8). SILO achieves the lowest average EER on VDD, but organic dysphonia remains difficult at 27.9% EER (Tab. 3).
-
Absence of transferable spectral differences. We expect little benefit when a generator leaves no differences recognizable by the spectral encoder. Uninformative spectral features can still influence predictions, so automatic fallback to SSL-only behavior is not guaranteed.
Follow-up on our responses
Dear Reviewer 9wTR,
Thank you for your follow-up question. As the discussion period is closing soon, we would like to kindly check whether our latest response on why the spectral branch helps and when it succeeds or fails (App. F.6, Figs. 13-14) addresses your concern.
Please let us know if anything remains unclear. We would appreciate your reconsideration of your assessment and rating in light of these responses.
Thank you for your time and consideration.
Response to Reviewer 9wTR: SILO has no high-frequency constraint; evidence that the spectral branch contributes
We thank the reviewer for the constructive feedback. However, the review describes a mechanism that differs from the one we propose, so we clarify that first and then give the evidence that the spectral branch is used, together with an additional ablation. Table and appendix numbers below refer to the revised PDF.
What SILO does and does not claim. SILO does not place a frequency constraint between the low-rank factors, and we do not claim that the constrained LoRA learns high-frequency content faster or better. The middle factor diag(α) holds the signed amplitudes of the residual, and their absolute values ∣αi∣ are exactly its singular values (Prop. 1). The geometric constraint controls the strength of adaptation and the preserved-subspace constraint controls which pretrained directions may change (Sec. 3.4, L192-195; Theorem 1). Neither refers to the high frequencies mentioned by the reviewer. Spectral evidence enters through a separate path: a frozen LFCC encoder produces zt, and a second low-rank map, ΔWczt, scaled by a learned utterance gate, is added to the SSL projection (Eq. 2; Secs. 3.2-3.3; Fig. 3). The LFCC front-end is linear in frequency across the full band (120 coefficients from 140 filters, App. D.4) with no emphasis on high frequencies. Therefore, our claim is complementarity: spectral features expose transferable synthesis artifacts but are fragile to acoustic variation, while SSL features behave the other way round (Sec. 1; Fig. 1).
Moreover, our work does not use any technique related to "SUV". Could the reviewer clarify which technique is meant? If SVD was intended, our three-factor parameterization is indeed inspired by the SVD (Sec. 1, L075-082; Fig. 2), and it involves no frequency constraint.
Evidence that the spectral branch contributes. Our submission already provides both theoretical and empirical evidence that the spectral branch contributes:
In case these results do not fully satisfy the reviewer, we additionally provide an ablation that isolates the contribution of each branch of SILO (EER %, lower is better, all models trained on WaveFake; added to the revised paper as Tab. 6 in Sec. 5.2):
As shown in the table, the SSL-only branch has the highest EER on MLAAD (which covers 116 synthesis systems unseen during training), while the spectral-only branch has the highest EER on ITW (which includes many acoustic variations: background noise, room reverberation, etc.). Full SILO, which combines both branches, obtains the lowest EER on ASVS-19, ASVS-21, and MLAAD, with 4.35 on ITW.
Questions: requested experiment on a toy dataset and proof.
We do not have an analytical result on faster learning of any particular frequency band because the paper does not claim one and does not place a frequency constraint between the low-rank factors. For the same reason, a toy experiment on high-frequency learning would test a property that SILO neither has nor claims. The properties the paper does claim are proven (Prop. 1, Theorem 1, Props. 3 and 4) and tested by the ablation above.