- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes two regularizers for polynomial regression. They give larger penalties to higher-degree terms at the same coefficient magnitude while keeping nonlinear penalty growth. The paper provides optimization results and evaluates the methods on nine univariate regression datasets.
Critical strengths
-
The paper explains the problem with pure-power penalties clearly and proposes two simple fixes. The resulting models remain explicit and easy to inspect.
-
The experiments include several standard baselines and statistical tests. The authors clearly acknowledge that the proposed methods do not show a consistent prediction advantage.
Critical weaknesses
-
The practical benefit over degree-weighted lasso is still unclear. That simpler method already penalizes higher-degree terms more, and the experiments do not show a consistent improvement over it. A concrete example showing when nonlinear penalty growth is useful would make the contribution more convincing.
-
The experiments mainly evaluate prediction error, while the motivation also emphasizes model structure and interpretability. The reported coefficient counts do not clearly show whether the proposed methods produce simpler or more stable models than standard regularizers. A direct comparison of model complexity and coefficient stability would better support these benefits.
Questions for authors
Refer to the weaknesses above.