- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EffSelect, a feature-value selection framework for deep recommender systems that aims to reduce redundant feature values and the corresponding embedding parameters while maintaining prediction performance. The framework first uses MFCS to select a small subset of training data for efficient pretraining, and then applies FeatIS to estimate feature-value contributions through a gradient-based mechanism. The most important feature values are retained for model retraining.
Critical strengths
- The method enables efficient feature value selection without additional learnable parameters.
- Experiments on four datasets demonstrate competitive performance with fewer model parameters.
Critical weaknesses
- The paper defines feature-value importance in Eq. (7) as the loss change caused by removing a feature value. However, the proposed method then uses Taylor expansion and integrated gradients to estimate importance scores, as shown in Eqs. (8)–(13). The connection between these estimated scores and the loss-change definition in Eq. (7) is not sufficiently justified. This is consequential because the validity of the feature-value selection criterion depends on whether these scores faithfully approximate the intended importance measure.
- The empirical evaluation is limited to a single feature-value selection ratio, , and does not provide a comprehensive comparison with baseline methods across different selection ratios. Evidence based on such a narrow setting is not particularly convincing. In addition, EffSelect underperforms baseline methods on the Avazu dataset, raising concerns about its generalizability and robustness across different types of recommendation datasets.
Questions for authors
- Could the authors clarify how well the estimates in Eqs. (8)–(13) approximate the actual loss changes defined by direct feature-value removal in Eq. (7)?
- Could the authors justify evaluating only a single feature-retention ratio, or provide any existing sensitivity results across different ratios? Additionally, could the authors explain why EffSelect underperforms relative to other methods on the Avazu dataset?
- The paper aims to satisfy both Proposition 1 (Distribution Consistency) and Proposition 2 (Feature Coverage Maximization). Given the long-tail distribution of the data, however, greedy feature-coverage maximization may disproportionately select samples containing rare tail features, creating a discrepancy between the selected-sample distribution and the original data distribution. How can Proposition 1 still hold under this greedy feature-coverage objective?
- The authors characterize the proposed method as both efficient and robust, but the experimental section provides no robustness analysis to substantiate the robustness claim. Could the authors clarify what evidence supports the claimed robustness? In addition, are any statistical significance tests available to support the reported superiority of the proposed method?
- The evaluation uses only a single feature-value retention ratio, . Could the authors clarify why this ratio was chosen and whether EffSelect remains effective under different feature-value retention ratios? In particular, do its relative advantages over baseline methods persist when the retention ratio is varied?
Sincere thanx again!
Dear Reviewer,
Thank you for your constructive reviews, which have helped us strengthen our paper. As you may appreciate, your rating is particularly important at this stage. With the discussion ddl approaching, we would like to ask whether our current response is convincing enough for you to support our work. If there are any further points for discussion, please feel free to leave a comment.
Best,
The Authors of EffSelect