- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CRAFT-GBM, a feature selection framework for LightGBM, where the feature selection pool in each round is chosen based on the historical split gains.
Critical strengths
A feature selection helper for the popular boosting library LightGBM has potential real-world impact, since high-dimensional training with LightGBM is widely used and expensive in practice.
Critical weaknesses
The theoretical analysis is about the feature's average gain at the root slit, not wheater the feature is useful for all of the current tree. For example, the features that are useful at deeper level may not be useful at the root level, and can be removed by CRAFT-GBM. Further analysis/ablation on this would consolidate the finding.
Questions for authors
How does CRAFT-GBM compare with a simple baseline that trains on all features for the first 20 rounds and then only uses the fixed top-K features ranked by accumulated gain? It would be important to see how much a naive implementation of the same intuition achieves in practice compared to this more sophisticated setup. If the simple baseline performs similarly, the benefit of the proposed method would be unclear.