- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
From the paper: “We study pipelines that compare an analysis window with a background reference and interpret the leading analysis mode as an anomaly—for example, a seismic event against ambient noise or a climate pattern against climatology. Write Σ for the analysis-window covariance, C for a quiet reference covariance in the same feature space, and Σ − C for their background-adjusted contrast. We show that Σ alone does not identify an anomaly: the same matrix admits pure-background and anomaly-plus-background decompositions, identical at second order when the anomaly lies along the background axis. Under partial contamination, the calibrated direction remains fixed while the whitened eigen-gap required for finite-sample certification shrinks to zero at same-record, where the direction is unidentified. Under independent sub-Gaussian sampling from the rank-one covariance model, a quiet held-out background recovers a residual spike above concentration scale, but that spike need not be EOF1 of Σ. We prove observational equivalence and a sharp gap law, and introduce a Contrast Audit Procedure (CAP) that separates declared guard passes from conditional, theorem-backed direction certificates and otherwise abstains. An optional held-out-control calibration bounds per-record null returns under exchangeability without assuming independent guards. On the public INSTANCE benchmark, with station keys held out and guards frozen, both guards pass 240/299 earthquakes and 13/264 noise records. Known-direction injections into the 264 held-out real-noise backgrounds reach 98.1% accurate CAP returns at twice the frozen strength threshold; on real LOCATA recordings, frozen guards return 11/13 sources versus 1/13 inactive controls with 2.1◦ median azimuth error. We release our code, prespecified splits, results, and reproduction instructions in our anonymous repository for replication.”
Critical strengths
This is a very weird paper.
Critical weaknesses
My criticism is based on the following facts.
- The first paragraph of the paper reads as: “Background adjustment is meant to support a consequential decision: whether a reported direction is evidence of an event or merely structured background. A stable leading mode does not resolve that distinction. The reference determines what can be concluded. Analysis covariance alone and same-record calibration cannot certify the label. A quiet held-out reference supports a direction claim only after spike, gap, and sampling conditions clear under thresholds fixed in advance.”
The paragraphe has 5 sentences. Sentence 2: “A stable leading mode does not resolve that distinction.” What is “a stable leading mode”? Undefined and the sentence is hardly understandabl.
Sentence 3: “The reference determines what can be concluded”: What is the reference here? No definition or explanation of it has been given so far.
Sentence 4: “Analysis covariance alone and same-record calibration cannot certify the label.” What does “Analysis covariance” mean? Indeed the paper propose a lots of analyses on covariances: does this mean that none of the proposed analyses is useful? If so, what is the paper’s purpose?
Sentence 5: “A quiet held-out reference supports a direction claim only after spike, gap, and sampling conditions clear under thresholds fixed in advance.” The English use itself is problematic here. I cannot figure out the meaning of the verb-complemet combination in the complement “after …. clear under thresholds”.
Therefore in the very first opening paragraph with 5 sentences, four of them are unclear with undefined or ambigorous terms. This shows how low is the presentation quality of the paper.
- On the technical side: Lines starting from 108 describe 5 main contributions of the paper. The one reads as: “ (1) We formalise analysis/reference covariance decompositions (§2) and prove observational non-uniqueness with aligned collapse (§3).” I thus paid some attention to the “observation non-uniqueness result”, namely Proposition 3.1, stated from line 165 (page 4. Its proof is given on page 15, lines 767-776. All is about a simple calculation on a rank-1 perturbed spiked covariance matrix: it is at the level of a first undergraduate course in linear algebra. The result of the proposition is a simple linear algebra result. I cannot find any significant new insight compared to the abundant literature cited by the authors, e.g., in the two paragraphs in Introduction, lines 041-081 and lines 093-104, respectively.
This shows the low level of the claimed “main contributions” of the paper.
Questions for authors
Your AI statement: “In this work, we used generative AI tools to assist with grammar and readability, coding, and feedback on experimental design and the interpretation of results. The authors independently reviewed all AI-assisted contributions and take full responsibility for the methods, analyses, interpretations, and final manuscript.” I suspect that AI has wrote most of the presentation of the paper including literature search. For example, the first paragraph I analyzed in details above is written by AI to me. However, the authors failed to declare such AI use properly according to the conference requirement.
3 comments
Follow-up
Thank you for your clarification. However, there still exists a lot of similar clarity issues in the revised article which makes difficult to recommend acceptance.
Clarified task, directions and guarantees
CLARIFICATION Your follow-up prompted a closer check of the remaining terminology and conceptual links. We have prepared focused exposition revisions to the 11 November version. The problem, estimator, assumptions and numerical results are unchanged.
Our task is to recover a direction of added variation relative to a background record. Weight-one contrastive PCA supplies the covariance-difference direction. Under the rank-one model, we derive an exact law for gap loss as signal leaks into the reference while the variance-ratio direction stays fixed (Theorem 3.1). With independent sub-Gaussian samples and the stated reference conditions, we bound contrast and whitened-direction errors separately (Theorems 4.1 and 3.3). A failed gap check need not imply an inaccurate contrast direction.
WHAT WE CLARIFIED
- Task and directions. To address the undefined and overloaded terms identified in your original review, we now place “preprocessed window covariance” beside the first use of EOF1 (abstract, p. 1, lines 010–014). Section 2 separately explains the window mode, contrast direction and variance-ratio direction, and gives the two actual contrasts in the existing diagonal example (p. 3, lines 126–151). We also distinguish reference quietness, holding observations out and sampling independence. The introduction now names the exact gap law and separate angle bounds (p. 2, Research gap) and groups the same scientific components around these questions (p. 3, lines 108–123).
- Checks and guarantees. The earlier phrase “every return inherits the reference's side information and inferential scope” compressed the conditions and output. Section 5 now describes each threshold comparison and defines a margin as score minus threshold. It states the theorem's actual probability event: under its assumptions, the probability that CAP returns and an angle bound fails is at most the stated failure level; this is not coverage conditional on returning (p. 6, lines 270–288; Table 2, lines 297–305). The coordinate mapping after Theorem 3.3 makes clear that its angle bound concerns whitened vectors (p. 5, lines 229–230). We preserve the distinction between the spike-only contrast-angle bound and CAP's stronger separation requirement.
- Evidence and physical meaning. Instead of “development-frozen declared-mode guard passes,” Section 6 says that we fix thresholds on development records and apply them unchanged to held-out records (p. 7, lines 339–347). The existing injection construction is now described in the main text (p. 8, lines 425–427). LOCATA's covariance features and largest-loading-to-azimuth mapping explain what the optical comparison measures (p. 9, lines 460–467). Figure 6 defines Etna's repeatability statistic and assigns the 0.5 cutoff to block-return rates (p. 9, lines 479–482). The abstract also makes the 98.1% denominator explicit: all 264 injected backgrounds, rather than only returned directions.
These revisions make the contribution directly assessable: how a reference identifies the added direction, how sampling error limits recovery, and why accurate recovery can coexist with weak background-relative separation. The physical comparison provides a concrete use case: CAP returns 11/13 active LOCATA recordings versus Roy's 7/13 at the same 1/13 inactive count, with 2.1° median error among CAP's returns (Table 3). The model-based bounds quantify direction error under their assumptions; optical tracking independently evaluates the selected acoustic directions.
Response to Reviewer wCEq
CLARIFICATION We rewrote the opening to introduce the window, background record and leading eigenvector before stating the inference question. The elementary example identifies missing background information. We show why recovering an added covariance direction and establishing its separation relative to background are different claims.
Here “analysis covariance” means the covariance of the window being examined, not the act of analysing a covariance matrix. A “reference” is a separate record intended to describe background variability. We removed “stable leading mode” and “clear under thresholds.” Under our rank-one model, a quiet reference identifies the contrast even when the window covariance alone cannot justify an anomaly label. Revised locations: Section 1 opening, p. 1, lines 036–041; Figure 1 caption, p. 2, lines 067–071; worked contrasts, p. 4, lines 182–184.
DIRECT ANSWER Proposition 3.1 is elementary. We use it as a minimal non-identifiability example, not evidence of technical difficulty by itself. We revised contribution (1) and the Section 3 opening to give it that role. The spiked background illustrates alignment and direction disagreement; the finite-sample bounds allow general C≻0 under their stated conditions. We corrected Section 2's overly narrow description of where the example family is used (p. 3, lines 156–159).
For a concrete reading, Σ=diag(3,1) has leading direction e1 both when C=Σ (pure background) and when C=I with a rank-one addition 2e1e1⊤. A quiet reference distinguishes zero contrast from that addition; more precise estimation of Σ alone does not. The revised worked example states the two contrasts explicitly (p. 4, lines 182–184). The later bounds answer the next question: how much sampling error those reference-supported direction and separation claims tolerate under the stated model and independence conditions.
We retain cPCA at weight one, which extracts top(Σ−C). We establish when a quiet reference identifies the added covariance direction and how sampling error limits direction and separation claims under our rank-one and independence assumptions. For analysts comparing event and background windows, this distinguishes recovering an added direction from resolving its separation relative to background. Our exact leakage law shows why an unchanged generalised direction can conceal vanishing separation. Our bounds account for covariance and whitening error for general positive-definite backgrounds, controlling the contrast and whitened directions separately. We separate fixed-cutoff returns from certificates with angle bounds; CAP withholds the direction when its reference or separation requirements fail. Optional exchangeable controls bound the null-return probability for one record.
We distinguish a conditional contrast-angle bound from measured azimuth error. In LOCATA, we compare returned azimuths with those derived from optical source positions. Revised locations: contribution (1), p. 3, lines 112–122; Section 3 opening, p. 4, lines 168–171; the interpretation in Section 7, p. 10, lines 502–539.
We test the resulting claims against event labels, injected directions and physical measurements. INSTANCE's frozen guards return 240/299 held-out earthquakes and 13/264 noise records, but those event labels do not validate directions. Known-direction injections supply that target on real backgrounds. LOCATA supplies a physical check: 11/13 active recordings return versus 1/13 inactive controls, with 2.1∘ median error among returns against optical tracking. These endpoints show what the reporting rule can retain, while the matched comparisons preserve losses: Roy selects more INSTANCE events, and bootstrap has more accurate returns at CAP's frozen spike cutoff. The combined evidence supports a useful distinction between a reproducible variance pattern, an identified covariance addition and a physically accurate returned direction (Table 3, p. 10, lines 487–495). LOCATA has only thirteen recordings from one room and array, which limits transfer.
CLARIFICATION The submission form already disclosed writing assistance, retrieval/discovery and research ideation/execution. The manuscript statement was less explicit about the tasks. We expanded it to enumerate literature discovery and checking, conceptual and theoretical development and proof assistance, experimental design and interpretation, coding, synthetic-data simulation and data processing, and drafting or editing prose and displays. The revised statement also covers the current response preparation and retains author responsibility for the work. We address the identified writing defects directly; we do not use prose style as evidence for or against particular tool use. Revised location: AI use statement, p. 11, lines 540–547.