- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies warm-start recommendation for combinations that are globally observed but new to a particular user. SCFR adds a learned correction to a frozen ranker, combining lower-order residualization of factor-pair features with curvature-based directional regularization. The experiments report target-cohort improvements alongside overall and non-target non-inferiority checks.
Critical strengths
-
Separating redundant lower-order information before regularizing weakly supported directions is a coherent approach. Using comparison-loss curvature to guide regularization provides an interesting statistical motivation.
-
The supplementary experiments are detailed, with extensive experimental analyses and descriptions of the experimental conditions.
Critical weaknesses
-
Clarify the correction setting and its objective. I may be missing some context in recommendation, but the intended application and objective of the proposed correction remain unclear to me. (i) If it is intended for fine-ranking, freezing an existing ranker and adding a correction to its prediction scores does not seem to me to be a typical formulation. For comparison, PACC models position bias within a jointly trained click/conversion predictor [1], rather than freezing a ranker and adding a learned correction term based on specific factor combinations to its prediction scores. (ii) If it is intended for calibration in applications such as advertising, applying a shared strictly increasing calibration function preserves the relative ordering of prediction scores. How does the proposed correction relate to this setting and to calibration methods such as AdaCalib and DESC [2,3]? (iii) If it is intended to support feature engineering, post-hoc feature attribution generally analyzes model predictions rather than directly correcting recommendation outputs [4]. I therefore encourage the authors to provide more related work explaining when freezing the original ranker and adding a correction term to its scores is appropriate, and to briefly introduce the task background in the Abstract or Introduction.
-
Review the writing and logical flow more carefully. The prose has noticeable features of AI-assisted writing, and some passages interrupt the flow of the argument or make abrupt logical transitions. For example, the manuscript repeatedly emphasizes that its theory does not guarantee NDCG improvement, giving parts of the discussion a repetitive, defensive tone. The authors should review and revise these passages more carefully.
-
Validate on larger datasets. The reported numbers of eligible warm users and items in each domain are below 100,000 (Table 6), which is a small scale for recommendation scenarios. I recommend validating the results on a larger dataset, such as AliCCP.
-
Include more feature-interaction baselines. The baseline comparisons are insufficient. Since the paper focuses on feature combinations, established feature-interaction models such as Wide & Deep [5] and FinalMLP [6] should be considered. The paper includes DCNv2-head as a correction module, but how does the original DCN-V2 perform? Please include this comparison or provide references supporting the rationale for the current baseline selection.
References
[1] Yibo Wang et al. Click-Conversion Multi-Task Model with Position Bias Mitigation for Sponsored Search in eCommerce. SIGIR, 2023.
[2] Penghui Wei et al. Posterior Probability Matters: Doubly-Adaptive Calibration for Neural Predictions in Online Advertising. SIGIR, 2022.
[3] Shuai Yang et al. Deep Ensemble Shape Calibration: Multi-Field Post-hoc Calibration in Online Advertising. KDD, 2024.
[4] Ian Covert, Scott Lundberg, and Su-In Lee. Explaining by Removing: A Unified Framework for Model Explanation. JMLR, 22(209):1–90, 2021.
[5] Heng-Tze Cheng et al. Wide & Deep Learning for Recommender Systems. 2016. Paper.
[6] Kelong Mao et al. FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction. AAAI, 2023.(https://ojs.aaai.org/index.php/AAAI/article/view/25577).
Questions for authors
See the weakness.