acceptodds
Published as a conference paper at NeurIPS 2026

Brute-Force Jailbreaks and Codon-Aware Watermarking for DNA Foundation Models

Munish B Persaud, Amrit Singh Bedi, Souradip Chakraborty

Abstract

Open-source DNA foundation models such as Evo2 generate sequences with local nucleotide identity to known human-pathogenic viruses under brute-force sampling alone, with no domain expertise, prompt engineering, or access to model internals. The bottleneck for biological misuse is therefore the model's prior, not the attacker's sophistication, and a deployable defense must operate where the attack does: at the codon layer. First, we characterize the attack. On JailbreakDNABench's pathogenic viruses, brute-force Best-of-N sampling against Evo2 succeeds for a mean of viruses at 7B across two independent trials (, range , matching GeneBreaker's three-component engineered jailbreak pipeline at ) and at 1B (, single curated trial, GeneBreaker's reported ), without any guided search or learned attack model. Probing Evo2's outputs, we find generations are not memorized: appear verbatim in NCBI nt, recall a single strain cleanly, and codon-position mismatches are biologically structured rather than random (, ; wobble-position synonymous rate , near the per-virus codon-usage baseline and well above the uniform-mutation null). Verbatim or near-verbatim training-data filtering would therefore not have prevented these generations. Second, we present a deployment-time defense. Because the attack exploits codon-level wobble structure, the defense must too. WobbleGuard is a zero-training provenance scheme whose contribution at the detection layer folds the genetic code's known synonym structure into the scoring rule. At an in-sample-calibrated threshold ( FPR by construction on natural NCBI pathogen fragments, ; cross-key range over independently sampled keys), the composite detector retains TPR under full synonymous codon substitution, the regime in which a nucleotide-level KGW port collapses to TPR, and detects of unperturbed watermarked Evo2 generations at both 1B and 7B scales. The attack works because brute force suffices; the defense works because it speaks codons.

Related papers

See more related submissions when the market opens.