- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes a post hoc speech watermarking algorithm, KeyBound that the watermark is both host-dependent and keyed. To achieve this, KeyBound masks the watermark payload with a private key and embeds the watermark audio, generated conditioned on the masked watermark payload. The framework's watermark decoder decodes the watermarked audio and outputs, if the audio is watermarked, the watermark payload. The watermark payload can only be decoded with the private key. This is how the watermark is keyed. For the host-dependent feature, it projects the masked watermark payload into latent space through an MLP and a FiLM module together with the projected host latent features. During the training process, it introduces a forgery loss that encourages the model to differentiate a watermark that is not from the matched host.
Critical strengths
-
The paper identifies the research gap where the keyed watermark and host-dependent watermark are not unified, and the current methods only focus on one or another.
-
The introduction of the mask key and the dual verification heads can further prevent watermark forgery by the user. With the secret key, it mathematically proves that the probability of an attacker successfully forging a watermark is very low.
-
To make the watermark generation process host-dependent, the paper uses a FiLM module to condition the watermark generation process on the masked watermark payload.
Critical weaknesses
-
It is not clear why the host anchor module ( C()+FiLM ) provides the host-dependent property that is unique in this paper. C converts host audio into the spectrogram domain, followed by a CNN layer. Then the FiLM fuses this feature with the masked watermark payload feature. However, a similar architecture was used in both Timbre and AudioSeal. Timbre converts the host audio into the spectrogram domain and concatenates the feature with the watermark payload features. AudioSeal also does a similar feature-merging operation. This type of concatenation can also be a type of feature merging, thus creating a host-dependent watermark generation. If the paper argues that the FiLM module provides more fine-grained feature merging, the experiment is needed. Without it, I don't see the novel design of the anchor module.
-
For the keyed watermark mechanism, the dual-head module is from AudioSeal. The XAttnMark has a similar design, where it uses an embedding table to encode the watermark payload. This embedding table can also be considered to be a secret key.
-
Try to use simpler words and short sentences, which can help the reader follow the paper. There are some math notations not explained and the Table 1 is not described in the paper.
Questions for authors
See the weaknesses and the following questions
-
What is y in Section 3?
-
What is host analysis C in Sec. 3.1
-
In the Fig. 1 caption, not all notations appear in the figure. Can you elaborate on it?
-
What is and z in Sec. 4?
-
Where is the explanation of transplant-negative training in Sec. 4?
-
What is in Sec. 4.2
-
Where is the description of Table 1?