- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper introduces the Resolution-aware Nucleotide Spectrum (RNS), a truncated discrete Fourier transform (DFT) of four nucleotide indicator signals, as an auxiliary pretraining target. RNS reduces to nucleotide composition at and uniquely determines the sequence at full resolution. The authors establish completeness, a Parseval–Hamming identity, and a reverse-complement rule. SpanDNA, a 117M-parameter BPE Transformer, jointly optimizes masked language modeling (MLM) and regression of a 36-dimensional RNS-4 target from a span-weighted pooled representation, discarding the auxiliary head after pretraining. Across three pretraining and three fine-tuning seeds on 18 NT benchmark tasks, mean MCC improves from 0.6421 to 0.6500, with gains across all seeds and on 15 of 18 tasks. Additional analyses include a fixed-descriptor sweep over , frozen-representation probes, and a single-seed comparison against alternative targets.
Critical strengths
- Method adds zero inference cost, since the head is discarded after pretraining and the encoder, parameter count and latency are unchanged (Fig. 7)
- Rigorous design: three pretraining seeds, three finetuning seeds each, with a clearly specified statistical protocol.
- The component analysis makes a real case for retaining phase, showing that phase-retaining coordinates outperform magnitude alone as fixed descriptors (Fig. 2b).
- The writing is clear and the scoping is honest, with the authors openly acknowledging that they cannot attribute the gain to the spectral form.
- The core experiments are reproducible, with code, tokenizer, configs and hyperparameters all provided.
Critical weaknesses
- SpanDNA does not outperform a comparable existing model. DNABERT-2, rerun locally at the same size, wins 14 of 18 tasks. The overall tie depends on splice donors, where DNABERT-2’s reported score duplicates its splice-all score (Table 4) and should be verified.
- The improvement over MLM is small and uneven. It averages under one MCC point and comes mostly from splice and enhancer tasks, while the histone and promoter confidence intervals include zero (Table 7). The significance tests also treat overlapping tasks (e.g. splice all vs. acceptors and donors) as independent.
- Key ablations are missing. The paper is framed around resolution, yet every pretraining run uses R = 4. Without an RNS-only or randomly initialized baseline, it is also unclear how much each objective contributes.
- The evaluation does not test the paper’s motivation. RNS is meant to make sequence statistics easy to read out linearly from pooled representations, but all downstream tasks fully finetune the encoder. The probing analysis only shows that the supervised coordinates become recoverable, which is expected. It uses one task and one seed pair, and is never linked to downstream gains.
- The theory does not apply to the target actually used. Completeness and the Hamming identity require the full spectrum (~500 frequencies for 1,000-bp windows), but training uses only four. RNS-4 is essentially base composition plus coarse trends at 250-bp scales and above. The paper should state what this captures and what it misses.
Questions for authors
- Why do H3K9me3 and promoter TATA decline under RNS pretraining (Table 8) when RNS-4 features improve all 18 tasks as fixed descriptors (§4.2)?
- Do the splice-site gains survive randomly shifting the finetuning inputs, given that a site-centered window makes the exon/intron composition contrast exactly the low-frequency signal RNS-4 encodes?
- Does RNS still help under k-mer or single-nucleotide tokenization, given that DNABERT’s fixed k-mers lead on all three splice tasks?
- Does a magnitude-only target reproduce the gain, since Fig. 2b shows phase matters for fixed descriptors but not for pretraining?
- How were λ and its warm-up chosen, how sensitive are results to λ, and was λ re-tuned for the composition and Multiscale targets?
- Why does MLM-only trail DNABERT-2 on most non-splice tasks at similar size and corpus, and would RNS help as continued pretraining of DNABERT-2?
- Does the gain hold under frozen-encoder probes on the downstream tasks, which is what the paper’s motivation predicts?
- Does the MLM-only non-DC R² stay negative with cross-validated α?
2 comments
I thank the authors for their response and additional experiments. The frozen-encoder probes are a useful addition, and the clarification regarding rounding resolves the Table 4 discrepancy.
However, my main concerns remain unresolved. SpanDNA still underperforms a parameter-matched DNABERT-2 on 14 of 18 tasks. Beyond splice prediction, the gains are marginal (approximately +0.005 MCC), and the distribution-shift experiment reduces the splice gain by half. The spectral target also shows only a narrow advantage over composition (+0.002–0.004 MCC) in a single short run, with no results across multiple seeds. Further, the ablations on R and λ, as well as a magnitude-only target, remain missing. Several questions (Q1, Q3, Q4, Q5, and Q8) also remain insufficiently addressed.
Given these unresolved concerns, I do not see sufficient evidence to justify raising my score.
Thank you for the specific checks on downstream prediction, splice alignment, and the external baseline.
1.The fixed-descriptor gains show predictive information beyond nucleotide composition for both tasks. The fine-tuning comparison measures the incremental effect of adding RNS to an MLM-pretrained encoder. Information useful to the fixed linear classifier need not improve this stronger baseline. The cause of the two task-specific declines remains open.
2.Yes. We fine-tuned on centered and randomly shifted 400-bp crops from the same 600-bp examples, retaining the focal site with offsets up to 64 bp. Mean gain fell from +0.0075 to +0.0039 MCC. Shifted gains were +0.0041, +0.0033, and +0.0042 across the three pairs. Both models' absolute MCC fell after shifting.
3.Overlapping k-mers in the original DNABERT share bases and encode local context. RNS complements this with a low-frequency Fourier target for composition and coarse positional structure. For a given DNA span, it is defined independently of tokenization and can be used with k-mer or single-nucleotide inputs. Our reported gains are for BPE. Transfer requires a matched MLM/RNS comparison for each tokenizer.
4.Full RNS-4 achieved 0.3997 mean MCC as a fixed descriptor versus 0.3618 for composition plus magnitude, a gain of +0.0379. Phase retains information about where coarse patterns occur relative to the window origin, which motivated retaining the real and imaginary components. Whether a magnitude-only training target reproduces the downstream gains remains open.
5.In the original pretraining runs, we fixed the maximum auxiliary weight at λ=50 and ramped to it linearly over the first 5,000 updates to introduce the auxiliary signal gradually. Global composition and multiscale RNS used the same weight and ramp. Sensitivity to λ remains open.
In a separate 5,000-update continuation from a shared MLM checkpoint, RNS-4 led same-width nine-bin composition by +0.0041 MCC on 18 frozen tasks and +0.0038 on four fine-tuned tasks. Excluding splice, the leads were +0.0030 and +0.0020. This compares targets under a fixed budget. Weight sensitivity would require varying λ within a target.
6.Architecture, tokenizer, and training recipe differ, so the gap cannot be attributed to one factor. Our continuation shows a benefit from adding RNS to our MLM checkpoint. Transfer requires a paired continuation from DNABERT-2. The unrounded DNABERT-2 scores are 0.847996 for splice-all and 0.848170 for splice-donors. Both round to 0.848 in Table 4. We will report more precision.
7.Yes. We froze the original encoders and fitted L2-regularized logistic regression to the final span-weighted representation. We selected regularization by validation MCC on paired splits and evaluated on the official test sets.
8.With the same fixed α=1, final-layer non-DC R2 was −0.1760 for MLM-only and 0.9089 for MLM+RNS. These values establish the gap at the reported setting. The sign under cross-validated α remains open. In Q7, the downstream probe selects its regularization on validation MCC and shows a positive test-MCC gain in all three checkpoint pairs.
Related concerns. Task overlap and theory.
Excluding splice leaves +0.0054 MCC on 15 fully fine-tuned tasks. Given overlap among splice tasks, we will describe the task-level intervals and tests as descriptive. The main comparison estimates the effect of adding RNS to MLM. RNS-only and random-initialization baselines would answer separate questions. For 1,000-bp inputs, RNS-4 captures composition and wavelengths from 250 to 1,000 bp. Exact reconstruction and the Parseval–Hamming identity require the full spectrum.