- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how the structural budget needed to retain forecasting accuracy differs between directly trained compact models and restrictions of trained full models. Using function-preserving interventions and exact linear controls, it separates representation exposure from training-covariance coupling as sources of this path dependence, with experiments across six forecasting families.
Critical strengths
- Careful separation of mechanisms. The paper goes beyond observing differences between training and restriction. Function-preserving interventions, kernel-preserving negative controls, and exact ridge solutions help distinguish representation exposure from training-covariance coupling and incomplete optimization.
- Substantial robustness analysis. The evaluation spans six forecasting families and includes checks across seeds, metrics, tolerances, and alternative capacity readouts. Reporting complete risk profiles alongside first-hit capacities helps qualify the findings and exposes cases where a single capacity value conceals different behaviors.
Critical weaknesses
- Practical implications remain insufficiently established. The main comparison considers restriction without subsequent refitting, whereas practical compression commonly includes post-pruning fine-tuning. Moreover, the structural budget does not directly measure parameter count or computational cost. A small fine-tuning control or cost-matched comparison would help establish whether the observed capacity gaps materially affect practical compression decisions.
- Presentation could be more concise and space-efficient. Some main-text figures occupy substantial space relative to the additional information they convey, while their captions and surrounding discussion repeat similar explanations. The authors should reconsider panel sizes and placement, consolidate overlapping illustrations, and tighten the writing to improve information density and reading flow.
Questions for authors
please see weakness above
please engage
Dear reviewers,
Please join the discussion with the authors.
Best, AC