- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies data sparsification for repeated training of industrial regression models. It partitions measurements by operating condition and constructs an initial support using clustering and geometric criteria. Retained samples receive frequency weights based on how many omitted observations they represent. A predictor is trained on this weighted support, with optional full-data warm-up. Its residuals on omitted training samples identify difficult examples for re-entry. Representative assignments and weights are then recomputed before a final training stage, while the predictor architecture remains unchanged. The goal is to reduce training computation while preserving coverage and regression accuracy.
Critical strengths
- The paper addresses a practical problem, reducing retraining costs without changing the deployed predictor. This makes the approach relatively easy to integrate into existing regression pipelines.
- The representative-frequency weighting provides an explicit accounting of the observations represented by each retained sample. The condition-specific construction also offers a straightforward way to maintain coverage across operating regimes.
- The experiments use paired initialization seeds and define temporal splits before constructing windows. Reporting per-seed results and unfavorable accuracy outcomes makes the empirical trade-offs reasonably transparent.
Critical weaknesses
- The feedback score in Eq. 25 produces exactly the same within-condition ranking as absolute residual alone, because Huber loss is monotone in residual magnitude. More broadly, the methodological advance beyond combining clustering, representative weighting, and hard-example selection appears limited.
- The computational accounting excludes full-pool feedback inference, representative reassignment, and weight recomputation, despite these being required pipeline operations. Without complete accounting or end-to-end runtime measurements, the reported fLOP reductions do not establish practical acceleration.
- The retention-matched baseline comparison is limited to battery MLPs, where the method beats Random in only two of four cycles. Its advantage over simpler selection methods is therefore not established for the other architectures or the NOx task.
- Comparisons between the non-re-entry and re-entry configurations change retention and topology handling alongside feedback, with some variants also differing in optimizer or checkpoint rules. These comparisons do not isolate the benefit of residual-guided restoration under otherwise identical conditions.
- Preserving total sample mass does not establish that the weighted support closely approximates the full regression objective. The paper provides neither an approximation-error diagnostic nor targeted rare-regime results showing that input-space representatives preserve task-relevant variation.
Questions for authors
See Weakness.
2 comments
Thanks to authors, the rebuttal address most of my concerns.
Response to Reviewer jJog
We thank Reviewer jJog for the precise technical comments. The revision addresses each point with explicit corrections and narrower claims.
W1 — Eq. 25 ranking and novelty. The observation is correct. Since both terms in Eq. 25 are monotone in |e|, their positive convex combination gives the same within-condition ranking as |e| alone, for any alpha in (0,1), including the fixed alpha=0.5. Numerical checks confirmed identical re-entry index sets. The revised text now states this explicitly, clarifies that alpha is not tuned, and removes any claim of extra discriminative power. The two-term form is retained only for tie robustness. We also accept that clustering, frequency weighting, and hard-example mining are established; the contribution is now scoped to their condition-partitioned, mass-preserving composition with residual-guided re-entry.
W2 — complete accounting and runtime. We accept the accounting concern. The revision includes full-pool feedback inference, cKDTree reassignment, post-re-entry weight recomputation, topology/landmark scoring, re-entry validation, all training and validation passes, and optimizer updates, with the same scope for all methods. Under this scope, MLP battery delta-FLOPs are -48.8% on HWFET, -11.2% on LA92, -34.9% on UDDS, and -7.2% on US06; overall reductions are 7.2%-87.2% for SOC and 19.9%-84.8% for NOx. Appendix H reports direct wall-clock for all 21 settings: the proposed arm is faster than Full in 19, faster than GradMatch in 21, and within +/-7% of Random in 20. For US06 MLP, median times are 482 s Full, 667 s Random, 692 s GradMatch, and 642 s Ours; the proposed arm is slower than Full there but faster than both baselines. The claim is now an accuracy-compute trade-off, not uniform speedup.
W3 — baseline breadth. The comparison now covers 3 architectures across 4 battery cycles and 3 gas-turbine years, giving 21 cells with three paired seeds each. On battery, the proposed method has lower mean MAE than Random in 8 of 12 settings; the remaining differences are unfavorable or within seed-level noise. On gas turbine, no accuracy win is claimed: MLP saves about 76%-85% FLOPs at up to 6.7% MAE cost, while FCN/CNN costs reach 13.4% near 40% retention. Against GradMatch, lower mean MAE is obtained in 7 of 12 battery settings. These cases are now stated in the revised claims and Limitations.
W4 — isolating residual-guided re-entry. A controlled random re-entry arm has been added with initial support, retention budget, optimizer state, checkpoint rule, and topology fixed; only candidate ranking differs. The number of re-entered samples is matched per cycle: UDDS 1987, HWFET 3263, LA92 1352, US06 5618. Residual-guided re-entry lowers MAE in 8 of 12 paired runs; random re-entry increases mean MAE by +4.7%, with largest gaps on UDDS (+12.0%) and LA92 (+7.2%). This isolates candidate ranking under otherwise identical conditions.
W5 — approximation and rare regimes. Appendix I adds diagnostics. Full-pool unweighted MSE is +4.4% to +14.9% for the proposed model, versus -1% to +6.5% for Random. In the hardest target-quantile bin, proposed-vs-Full MAE is -11.1% US06, -5.4% LA92, -1.7% UDDS, and +0.7% HWFET. The opposite extreme bins are also disclosed: +11.7% US06, +13.6% UDDS, +4.8% HWFET, and -1.9% LA92. These bins contain few samples, and the degradation is stated as a limitation. The revised text no longer implies that mass preservation guarantees close approximation of the full objective.
All corrections, expanded comparisons, accounting changes, wall-clock results, controlled re-entry test, and diagnostics are reflected in the revised manuscript.