- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates positive-pair construction in self-supervised learning (SSL) for multi-frequency eddy current testing (ECT). The authors argue that aligning signals from different frequency channels may suppress task-relevant information due to their different physical measurement operators. The paper compares same-frequency (AF2, AF2) and cross-frequency (AF2, AFx) positive pairs using SimCLR, DenseCL, and VICRegL, while the downstream defect detection task uses only AF2. Experiments on an ECT dataset show that same-frequency pretraining consistently outperforms cross-frequency pretraining. The authors also introduce PhysAug, a physics-informed data augmentation strategy, and evaluate its robustness to measurement perturbations.
Critical strengths
The paper provides a controlled comparison of same-frequency and cross-frequency positive pairs across three SSL methods.
Critical weaknesses
-
The core hypothesis needs stronger validation. The downstream task uses only AF2, while other frequencies are introduced during SSL pretraining. Thus, the observed performance degradation may also be explained by domain mismatch rather than the suppression of task-relevant information. Moreover, most cross-frequency SSL configurations still outperform the supervised baseline.
-
The novelty and generalizability could be strengthened. The paper mainly evaluates existing SSL methods on a single ECT dataset without proposing a new learning algorithm. Moreover, cross-view learning has already been extensively studied. The current evidence is insufficient to support the authors' claim of motivating "a directly testable criterion for auditing view design in other multi-channel scientific sensors."
Questions for authors
No additional questions.
2 comments
Thank you for the detailed response and additional experiments, which have addressed my concerns to some extent. However, I remain concerned about the limited novelty and generalizability of the findings, particularly given the evaluation on a single dataset.
We thank the reviewer for highlighting partner-frequency exposure as a possible alternative explanation for the observed AF2 transfer penalty.
The original comparison changed both the positive partner and partner-frequency exposure, making domain mismatch a plausible alternative explanation. An aggregate-exposure-matched control does not reproduce the penalty, while DenseCL still shows a penalty despite its transferred encoder receiving AF2 only, as detailed below. Our conclusion is target-conditional: co-registration and shared labels alone do not establish positive-pair validity for AF2 transfer.
W1. Domain mismatch and the supervised baseline. The balanced-exposure control and DenseCL routing result implicate the tested cross-frequency pairing policy, without isolating a unique mechanism: the control also changes BatchNorm populations and objective-specific batch terms (App. A), and DenseCL's keys and queue still carry the partner frequency. The representation diagnostics are consistent with stronger cross-view alignment: in all 27 cross-frequency encoders, unrelated cross-view pairs are more similar and the positive-versus-unrelated margin is smaller than in matched AF2+AF2 encoders (Sec. 4.3). On the supervised baseline, we agree: six of nine cross-frequency SSL means exceed CNN-PhysAug in point estimate (Tables 2–3). The primary penalty is relative to matched same-frequency SSL: all nine cross-frequency settings trail their AF2+AF2 references (Sec. 4.1, 4.6).
W2. Novelty. Existing cross-view SSL establishes the value of pairing related observations, but does not settle whether exactly co-registered, identically labeled frequency channels should be equivalent positives for a specified target (Sec. 5). For AF2 transfer, the tested cross-frequency pairing policies consistently incur a relative penalty (Sec. 4.1; Table 2). Our contribution is the controlled pairing comparison and a validation rule for other candidate pairings, not a new SSL objective. We deliberately use three established objectives: a new algorithm would be confounded with the pairing policy under test, and the result does not depend on a single objective.
W2. Generalizability. The penalty recurs across three SSL objectives and three partner frequencies, so it is not confined to one tested loss or pairing. We do not claim cross-sensor replication. The broader contribution is an evaluation strategy for co-registered sensors: use measurement physics to flag operator differences that may matter for a target, then test the positive-pair policy against an exposure-matched within-channel reference (Secs. 3, 6).
The criterion. We agree with this point, and the revised paper replaces the "directly testable criterion" claim with a decision rule (Sec. 3, 6): (i) flag operator differences that may alter target-relevant responses, using the measurement model or labeled calibration standards; (ii) compare a flagged pairing on labeled validation data with an exposure-matched within-channel policy, using a pre-specified metric and its uncertainty, and keep it only if the evidence shows any loss is below a pre-specified tolerance. The rule does not predict outcomes for untested sensors; it identifies which pairings need testing. The balanced-exposure control instead uses the held-out test set to examine the exposure explanation, not to select a policy.
We hope the new control and the narrower claims address both concerns.