- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DG-HCA separates reinforcement-learning supervision for recommendation reasoning from supervision for hierarchical SID decisions. Reasoning trajectories receive beam-ranking rewards; target-path SID actions receive positive credit and competing actions receive negative credit. When beam search misses the target, training adds a recovery suffix without changing the retrieved list. Experiments use Qwen3-1.7B on three Amazon categories, with component ablations and thinking/non-thinking comparisons.
Critical strengths
- The SID branch supplies supervision even when retrieval misses. Recovery inserts the target suffix only into the training action group, not into the beam or evaluation results (§3.4.2). This is a concrete way to train on beam failures without inflating measured retrieval.
- The ablations support a contribution from both branches. On Games, NDCG@10 falls from 0.0572 to 0.0506 without SID credit and to 0.0526 without recovery (Table 2). Removing the CoT loss also lowers all four Industrial metrics (Table 8), although those differences are small.
Critical weaknesses
- The benefit over simpler target-supervised training is unresolved. SID credit has a prescribed positive sign for the target and a negative sign for competitors. Appendix F.4 explicitly derives a local contrastive form. A1–A3 remove SID supervision or recovery, but do not compare against cross-entropy or a contrastive loss using the same beam candidates and recovered targets. These results therefore do not isolate the value of the clipped relative-credit formulation from the additional target supervision.
- The paper's own non-thinking results weaken the case for its chosen inference mode. Stage 3 without thinking has higher NDCG@5 and NDCG@10 on many cases (Table 3). On Games, Stage 2 without thinking already reaches NDCG@10 of 0.0641, above Stage 3 with thinking (0.0572) and without thinking (0.0600). Thinking does improve Stage 3 Recall@10, so this is a trade-off; the paper has not established why the added reasoning is the preferable operating point.
Questions for authors
- Attribution check: How does the SID objective compare with target cross-entropy or contrastive training when beam candidates, recovered targets, initialization, and training budget are held fixed?
- Clarification: Given Table 3, which accuracy/latency trade-off motivates using thinking-mode Stage 3 over the non-thinking checkpoints? Can the recommendation of this operating point be supported quantitatively?
3 comments
The added objective comparisons substantially address my main concern. Holding the supervision, recovery mechanism, initialization, and training budget fixed, DG-HCA outperforms the CE and contrastive alternatives on the reported results. The Ratio-InfoNCE comparison and the removal of clipping provide useful evidence beyond the original component ablations that the optimization formulation contributes to the gains.
The latency and long-tail analyses also clarify the intended role of thinking. These responses resolve enough of my original concerns to support acceptance. I will raise my rating from 2 to 3.
We would like to express our heartfelt gratitude for your thoughtful feedback, encouraging comments, and willingness to reconsider your assessment in light of our rebuttal. We are truly grateful for the time and effort you have devoted to reviewing our work, as well as your constructive suggestions and positive recognition of our efforts. Your support and encouragement mean a great deal to us, and we sincerely appreciate your careful consideration and valuable insights.
Dear Reviewer,
Thank you again for your time and thoughtful review. As the discussion period is approaching its end, we would like to kindly follow up on our rebuttal. We would greatly appreciate it if you could share any further thoughts or let us know whether our responses have addressed your concerns.
We are also happy to provide any additional clarifications if needed. Thank you very much for your time and consideration!