- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper treats the response to a specified preprocessing operation as a measurable property of a brain representation. Its main statistic contrasts a delay-embedding spectral score before and after adding five aCompCor regressors, with scores referenced to channelwise phase-randomized signals. A post hoc ADNI analysis relates this paired response to clinical status, with a common-DCT sensitivity analysis on the same participants. Analytical constructions and simulations characterize sensitivity to joint organization and observation changes. A complementary analysis studies windowed functional-connectivity dispersion in future CDR-SB prediction, including an exploratory preprocessing-response comparison.
Critical strengths
-
The paper defines a testable measurement rather than treating preprocessing sensitivity only as an informal robustness concern. Specifying the operator, representation statistic, and paired contrast makes the question concrete. The paired analysis retains the relationship between the two preprocessing branches, and the common-DCT control helps distinguish the added regressors from differences in temporal nuisance modeling. This is a useful methodological framing.
-
The controlled analysis gives the measurement an appropriately limited interpretation. The constructions show sensitivity to joint structure with fixed channelwise laws, while observation changes can also affect the statistic. The paper therefore avoids equating sensitivity to collective organization with identification of a neural source. These limits are consequential because they prevent a clinical association from being overinterpreted as a biological mechanism.
Critical weaknesses
-
The response-specific empirical advance is limited in scope. The paired analysis reports an estimated positive association between clinical severity and the response of one spectral score to one specified preprocessing change. However, the main finding was developed post hoc in a single ADNI cohort. The common-DCT analysis strengthens that finding under an additional shared nuisance control, while retaining the same participants and the other measurement choices. The prognostic results in Section 6.4 primarily support window-FC dispersion, and Appendix M.4 provides an additional exploratory response comparison; neither independently validates the main spectral response. Together, these analyses support an interesting measurement case study, but the additional scientific understanding established by treating preprocessing response as a feature remains modest. This limited scope weakens the significance of the empirical contribution.
-
The formal analysis provides useful interpretive safeguards, but its methodological contribution remains modest. Proposition 1 establishes collective sensitivity by changing zero-lag spatial correlation while preserving the individual channel laws. This demonstrates the value of a joint observable over univariate summaries, but does not distinguish the delayed construction from sensitivity already available in joint covariance. The turnover and alias constructions explain why a score increase need not indicate better signal preservation and why identical observations cannot identify the latent source. These are valid and consequential limits. However, with the delay embedding and spectral score themselves acknowledged as established constructions, the formal contribution is principally a characterization of the selected measurement and its interpretive boundaries. I am not persuaded that linking these results provides a sufficiently substantial methodological advance to support acceptance.
Questions for authors
-
How should the stability under common DCT be interpreted alongside the individual branch associations? Table 1 reports similar paired clinical coefficients under the original and common-DCT designs, while Section 6.2 reports changes in absolute score levels. Please provide the BASE and A5 clinical coefficients under both designs, with their joint uncertainty, alongside the paired coefficients. Does the contrast preserve a clinical relationship that changes substantially at the branch level, or are the branch associations also stable while their score levels shift? Either pattern is compatible with a valid paired finding, but the distinction would clarify what the DCT control adds to the argument for treating preprocessing response as a separate feature.
-
Which measurement insight from the theoretical analysis extends beyond this particular score? Proposition 1 varies zero-lag spatial correlation while preserving the marginal laws, and Proposition 2 explains observation-only turnover through normalized spectral concentration. Which conclusions depend specifically on the delayed, phase-referenced construction, and which also apply to simpler normalized joint-covariance responses? Please state the transferable measurement principle, its assumptions, and the proposition or controlled result that supports it. If the intended contribution is instead the characterization of this particular observable, please explain what that characterization adds to interpreting the clinical response. This would help assess the scope and significance of the contribution without making a new experiment a prerequisite.
-
Which appendices do the two unresolved “Appendix ??” references point to? On p. 6, line 320, the reference is meant to identify the checked inputs and numerical discrepancies for the independent numerical reconstruction. On p. 10, line 492, it is meant to distinguish public execution from the restricted clinical pipeline and document independent numerical checks. Please provide the exact appendix or subsection number and page range for each reference, and clarify which reported checks each location supports. These references are needed to locate the evidence for the numerical verification and understand the scope of reproducibility from the public materials.
Thank you for the precise questions. Common DCT shifts the absolute score levels, while the BASE, A5 and paired slope estimates remain similar.
The submitted aggregate_results.json gives these slopes (HC3 SE), in percentage points of J per CDR-SB point:
The joint HC3 covariance matrices for [BASE,A5], in squared slope units, are:
\begin{bmatrix} 0.062155 & 0.041933 \\ 0.041933 & 0.082716 \end{bmatrix}, \qquad \text{Common DCT:}\quad \begin{bmatrix} 0.047915 & 0.017783 \\ 0.017783 & 0.036476 \end{bmatrix}.$$ The paired SE retains the positive branch covariance. For this response, we additionally reconstructed cross-design uncertainty from the unchanged archived 201-person cohort. DCT-minus-original slope changes (HC3 SE) are $+0.0128$ (0.1551) for BASE, $+0.0046$ (0.1793) for A5, and $-0.0081$ (0.0904) for the response. These are descriptive checks, not equivalence tests or independent validation. Mean $J$ changes from 16.415 to 15.286 for BASE and 13.794 to 12.229 for A5. DCT addresses a shared temporal-nuisance concern; it does not show unique stability of the contrast. Proposition 1 characterizes collective sensitivity by varying zero-lag correlation while preserving each channel's entire Gaussian marginal law. Static covariance also detects this change. The contribution is the exact response of the chosen population observable, its connection to finite-sample measurements, and the resulting interpretation of the clinical association. A transferable principle follows from Proposition 2. Take mutually independent, unit-variance processes $Z_i$, $U$ and $V$ with the same autocovariance. The channels are $X_i=Z_i+\sqrt{s}\,U$ and the proxy is $W=U+\tau V$, with $s>0$ and $\tau>0$. Writing $t=\tau^2/(1+\tau^2)$, normalized correlations before and after regression are $$r_0= \frac{s}{1+s},\qquad r_A=\frac{ts}{1+ts}.$$ For any continuous strictly increasing $g:[0,1]\to\mathbb{R}$, the response $g(r_A)-g(r_0)$ is negative for finite $s>0$ and approaches zero both as $s$ approaches zero and as $s$ grows without bound. It is therefore nonmonotone in shared observation noise despite fixed latent dynamics. This also applies to suitable normalized static-covariance scores. The particular rational formulas require the stated spectral eigenvalue branch; the turnover principle does not require delays or phase references. The alias result applies to every decoder of identical observed fields and proxies within the stated model class: different designated latent targets remain indistinguishable. Source attribution therefore needs additional identifying assumptions or measurements. This explains why a severity association or larger score cannot alone identify preserved neural signal. The clinical finding remains post hoc; the separate FC-dispersion prediction addresses a complementary endpoint. This person-level response and its identification boundary complement [pipeline multiverse sensitivity analysis](https://doi.org/10.1162/imag_a_00523) and [pipeline-invariant representations](https://arxiv.org/abs/2208.12909). Both broken references point to an omitted reproducibility section; we apologize. There is no corresponding appendix page in the submitted PDF. For p.6, line 320: original-score reconstruction agrees within $8.89\times10^{-16}$; 47 synthetic checks qualified the DCT adapter; separate OLS/HC3 reconstruction of all 20k bootstrap draws agrees within $6.23\times10^{-14}$. Direct Hankel/SVD checks cover four prespecified records (DCT counts 3,5,8,9; lengths 97,139,197,214), all 199 references in both branches, within $1.27\times10^{-13}$. Controlled-world checks cover 800 summaries and 160 complete scores. These verify implementation, not clinical replication. For p.10, line 492: public verify.py checks synthetic inputs, reconstruct.py reconstructs aggregate displays, and synthetic/reproduce.py with compare_synthetic.py reproduces controlled worlds. Human replication requires authorized ADNI inputs and Appendices B–E, pp.17–21. The restricted clinical pipeline and participant ledgers are not distributed.