- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper adapts TCAV to Raman spectroscopy by defining concepts as named spectral bands (user-specified wavenumber ranges) instead of example sets, and extends the framework from single bands to band pairs through three contrasts (Sum, Diff, Tradeoff). It applies this to a 1D CNN classifying six bacterial species from a public Raman dataset, reporting concept-by-class and pair-by-class TCAV score matrices together with a small perturbation-based check. The adaptation is sensible and the authors are candid about several limitations.
Critical strengths
- Misspecified significance test in Eq. (7). The significance test in Eq. (7) appears to be misspecified, and every frequency-based conclusion in the paper rests on it. As written, t = (TCAV_Q^{C,y,l} − μ_null) / (σ_null/√N′), with N′ ≤ N = 20, which is the form of a one-sample t-test applied to a mean of N′ observations. Each concept, however, produces a single TCAV score: the CAV is the average of the split weight vectors (5 splits for the named band, 3 for the control regions), and the score is then computed once from it. The numerator is therefore a single draw, not the mean of N′ replications of the null procedure.
Critical weaknesses
As written, t = (TCAV_Q^{C,y,l} − μ_null) / (σ_null/√N′), with N′ ≤ N = 20, which is the form of a one-sample t-test applied to a mean of N′ observations.
Questions for authors
- The control regions are described as 5–29 wavenumber indices wide, whereas some concepts are narrower than that (e.g. phenylalanine, 1000–1005 cm⁻¹). Were control regions matched in width to the concept being tested, and could part of the observed separation simply reflect region width?
- What does the Tradeoff contrast tell us that Diff does not, when both are evaluated on the same opposite-sign subset? 3.Several smaller issues concern the internal consistency and completeness of the manuscript. Section A.3 is an empty heading; the concept table is cited as "Table 1a" although it is labelled as panel (a) of Figure 1, whose panel (b) has no caption.