- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces DualRes, a compact vibration classifier that combines two time-aligned STFT resolutions with selective oscillatory memory. The model is evaluated under limited labeled-data budgets using recording-level train/test splits. The paper also reports component ablations and analyses of computational efficiency and memory usage.
Critical strengths
- The recording-level splits and explicit accounting of labeled duration make the scarce-label evaluation more credible.
- The compact architecture is well motivated for vibration signals. The no-rotation ablation supports the usefulness of oscillatory dynamics.
Critical weaknesses
- The component ablations use only one seed, despite substantial seed variation on some tasks. This makes the size and consistency of the component gains uncertain. Besides, jitter has little apparent benefit. Removing it leaves most results unchanged. Its intended role and the reason for retaining it are not clearly justified.
- Table 2 covers seven label budgets, but several baselines remain weak even at the largest budget. It is unclear whether this mainly reflects label scarcity, the training settings, or difficulty handling the domain shift. This makes it harder to attribute the performance gap specifically to better data efficiency.
Questions for authors
- Could you repeat the key ablations over multiple seeds and report the mean and variability of the gains?
- What is damping jitter intended to improve, and why retain it given the limited gains in Table 4?
- How do you interpret the weak baseline results at the largest label budget in Table 2? Can the available results distinguish label scarcity from training settings or domain shift?
5 comments
We would welcome your feedback on whether these revisions address your concerns.
Thank you for the additional experiments. They address my main concerns, and I’m willing to raise my rating to 3.
Added five-seed ablations, jitter justification and training-setting and motion-transfer studies
Response to Reviewer 3
Thank you for the assessment. We have expanded the ablations and added studies of training settings and operating conditions. Locations refer to the revised paper.
Responses to the weaknesses
W1. Seed variation and the role of damping jitter
We repeated the full model and all four controls across five seeds on all seven datasets. The controls use short-only inputs, long-only inputs, zero rotation or zero jitter. Each seed averages both predefined folds. Table 5 reports the mean and sample SD, and Table 16 reports paired full-model-minus-control differences.
Rotation improves mean macro-F1 on six of seven datasets, with effects from −2.18 to +9.85 percentage points. The resolution controls also show dataset-dependent effects. Short-only inputs perform best on Paderborn, while long-only inputs lead on KAIST and MCC5.
We have also explained jitter's purpose and reported its gains and losses by dataset.
Changes Section 3.3 (p. 5), Section 5.4 and Table 5 (pp. 8–9), Appendix H and Table 16 (pp. 29–30).
W2. Weak baselines at the largest label budget
We added two diagnostic studies to examine training settings and transfer between motion modes. The training-setting study tests three learning rates and 300/600 updates for five models. Settings are selected using held-out source recordings before target evaluation.
The motion study trains each model on three recordings/class. It then tests on separate recordings from either the same motion mode or the other mode. The test recordings are matched for class, fault severity, nominal speed and load. Both diagnostics use seed 41 and average the two predefined folds.
Figure 5 now includes all ten neural methods. Several comparators reach near-zero training loss yet obtain lower test macro-F1. This shows that low training loss alone gives an incomplete account of the performance gap. The added diagnostics examine how the gap changes with training choices and test conditions.
Changes Section 5.1 (pp. 6–7), Section 5.5 and Figure 5 (p. 9), Appendices G.3–G.4 and Tables 14–15 (pp. 27–29).
Answers to the questions
Q1. Multi-seed ablations with mean gains and variability?
Yes. Tables 5 and 16 now cover five matched seeds for every component control on all seven datasets. We calculate each paired effect after averaging the two folds within a seed.
For rotation, the gain is 9.85 ± 11.91 points on UORED, 6.67 ± 2.42 on HUST and −2.18 ± 10.50 on MCC5. These values show substantial variation on UORED and MCC5. Pairing the runs measures variation in the component's effect across seeds.
The ZIP includes the ablation configurations, seed assignments and commands that calculate the paired effects.
Locations Section 5.4 and Table 5 (pp. 8–9), Appendix H.3 and Table 16 (p. 30), Appendix J and Table 20 (pp. 32–34). ZIP details appear in
docs/RUNS.md.Q2. What is jitter intended to improve, and why retain it?
We welcome feedback on these revisions.
Damping jitter is intended to reduce dependence on one precise memory-decay rate. During training, we sample a positive damping multiplier once per window and channel. The multiplier is shared across time and has an expected value of one. We use the same strength, σ = 0.10, across datasets and disable jitter at inference.
The five-seed paired gains are 6.24 ± 3.47 points on UORED and 4.34 ± 0.92 on HUST. CWRU and Ottawa have zero change, while MCC5 changes by −0.91 ± 1.83 points. Thus, the strongest evidence for retaining this training regularizer comes from UORED and HUST. We keep one fixed configuration across datasets and report the effect on each task.
The no-jitter control preserves the random draw used by jitter, so subsequent dropout draws stay aligned.
Locations Section 3.3 (p. 5), Section 5.4 (p. 9), Appendix H.2–H.3 and Table 16 (p. 30).
Q3. Can the results distinguish data scarcity, training settings and domain shift?
In the motion study, increasing labelled duration from 6.144 to 36.864 seconds/class raises within-motion macro-F1 from 5.31% to 31.46% for PatchTST. The recording count stays fixed, although the additional windows also increase computation per update.
In the training-setting study, source-validation selection raises MSCResNet from 46.55% to 57.49% at 36.864 seconds/class. DualRes changes from 65.96% to 67.29%. At this budget, we retrain each model on the full labelled pool using its selected settings. After this selection, DualRes retains a 9.80-point macro-F1 advantage over MSCResNet at the largest budget.
In the motion study at the same duration, MSCResNet scores 58.66% within the training motion and 35.48% across motions. DualRes scores 68.60% and 72.84%, respectively. Thus, the effect of changing motion depends on the model. These results link the observed gaps to labelled duration, training settings and motion conditions.
Locations Section 5.1 (pp. 6–7), Appendices G.3–G.4 and Tables 14–15 (pp. 27–29).