- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ELGAR addresses popularity-calibrated item-side fairness in Semantic-ID (SID) based generative recommendation: exposure across fixed popularity groups is calibrated to their shares of raw training interactions. The method prepends a popularity-group token to each existing SID and fuses the backbone's group logits with a ledger-conditioned fairness head at the first decoding step. The Exposure Ledger records normalized group-exposure deviations and a clipped exposure-progress indicator. Training constructs label-driven exposure episodes from shuffled mini-batches and combines the generative objective, target-group supervision, and an expected one-step fairness-gain objective. During inference, a persistent ledger is updated from the displayed Top-K items after each request block, while each beam continuation remains within its selected group. Experiments on Beauty, Toys, Sports, and KuaiRec*, using TIGER, LETTER, and MiniOneRec, report lower exposure mismatch and higher Tail NDCG@10 than the corresponding vanilla backbones.
Critical strengths
-
The intervention point is well motivated for SID-based generation. Placing group allocation before semantic-prefix pruning gives the method access to groups whose items might otherwise disappear before post-hoc reranking. ELGAR retains the existing SID mappings and combines request-dependent relevance with accumulated exposure information at this control point. This is a useful design for bringing exposure allocation into generative retrieval, rather than correcting only the candidates that survive decoding. Target-group supervision also provides a concrete mechanism for balancing the fairness signal with user relevance.
-
The empirical evaluation covers four datasets and three backbones, including both encoder-decoder and decoder-only models. The reported results demonstrate a meaningful utility-calibration trade-off: on Beauty with TIGER, MGU@10 decreases from 0.1827 to 0.0703 and Tail NDCG@10 increases from 0.0018 to 0.0054, while overall NDCG@10 changes from 0.0303 to 0.0298. The fusion-loss ablation and the random-routing comparison further illustrate why exposure matching alone is insufficient. The granularity and alternative Head-Tail boundary analyses also provide useful evidence about the dependence on the chosen fairness configuration.
Critical weaknesses
- The experiments do not isolate the contribution of adaptive exposure feedback, which is central to the paper. The w/o Stateful Decoding ablation in Table 2 sets lambda_dec = 0 and removes the entire fairness-head contribution, including its request-dependent component, rather than only removing ledger feedback. The random-routing baseline in Appendix I is useful, but it discards request-dependent group relevance as well as learned feedback; outperforming it in NDCG does not establish the benefit of the proposed ledger mechanism over a relevance-aware exposure controller. A comparison that retains the relevance and fairness heads while freezing or removing only the ledger input, together with a simple relevance-plus-exposure-deficit controller at the same group-token step, would better separate the effects of group-token generation, additional supervision, and adaptive feedback. This matters because the current evidence supports the complete system more clearly than its distinctive feedback mechanism.
- The gap between training and inference needs further validation. Training resets exposure counts for each mini-batch and updates them using ground-truth items, while inference accumulates exposure from generated Top-K lists. It is unclear whether the learned feedback remains reliable over longer recommendation sequences or under different request orders.
Questions for authors
-
To assess the contribution of adaptive feedback, can you provide a control that retains the group-token generator, the fairness head, and relevance supervision while freezing or removing only the ledger input? A comparison with a relevance-aware deficit controller applied at the same routing step would also be informative. Please use comparable validation budgets and report the utility-MGU trade-off, since the random-routing baseline already achieves lower MGU at lower utility.
-
Could you clarify the intended state-sufficiency claim in Appendix J.2? With pi = (0.8, 0.2) and H = 20, counts n = (17, 4) and n' = (170, 40) produce the same ledger, (1/105, -1/105, 1), but Eq. (8) gives the larger fairness gain to Head in the first case and Tail in the second. Is the clipped ledger intended as an approximate state representation, and does retaining information about the exposure total materially change the results?
-
What request ordering and ledger-reset protocol are used for validation and test? To assess the training-to-serving transfer, can you report prefix-wise exposure mismatch and utility under multiple permutations of the same held-out requests, with variability across runs?
10 comments
Response to Reviewer FBdx - Part 2/6 (W1 & Q1)
W1 & Q1: Isolate adaptive exposure feedback using frozen-ledger controls (retaining the fairness head) and a relevance-aware deficit controller under comparable validation budgets.
R1(continued):
Table R1.2. Nonstationary.
| Policy | NDCG@10 | Tail NDCG@10 | Full-stream MGU@10 | Mean window MGU@10 |
|---|---|---|---|---|
| ELGAR () | 0.02893 | 0.00711 | 0.02750 | |
| Static Bias () | 0.00605 | 0.03776 | 0.05438 | |
| Fixed Head deficit () | 0.02993 | 0.00418 | 0.12072 | 0.14808 |
| Fixed Tail deficit () | 0.02936 | 0.01706 | 0.05542 | |
| Fixed zero deficit () | 0.02839 | 0.00361 | 0.14842 | 0.14843 |
| Dynamic bias controller () | 0.02905 | 0.00649 | 0.02046 |
Bold: best; : second best.
1. Comparison with static controls: ELGAR consistently delivers tighter local exposure alignment than all four static policies, especially when request mixes alternate. Compared with the four static controls, ELGAR achieved the lowest full-stream and mean window MGU in Default (0.01465 vs. 0.01657 and 0.01863 vs. 0.02457), and lowered nonstationary full-stream MGU to 0.01959 (vs. 0.03776 for Static Bias). Fixed Tail deficit had slightly lower full-stream MGU (0.01706 vs. 0.01959), but much higher mean window MGU (0.05542 vs. 0.02750). Furthermore, ELGAR achieved 17.6% higher Tail NDCG with 2.0% lower overall NDCG than Static Bias on nonstationary streams.
2. Comparison with the Dynamic bias controller: Both policies leverage dynamic exposure ledgers to achieve comparable aggregate alignment under stationary traffic, but ELGAR's neural ledger fusion yields substantially stronger local stability and tail accuracy under nonstationary shifts. Because the Dynamic bias controller also tracks the cumulative exposure deficit, it matches ELGAR on full-stream MGU (0.01400 vs. 0.01465) and mean window MGU (0.01842 vs. 0.01863) in Default, though ELGAR achieves 6.2% higher Tail NDCG with only 0.49% lower overall NDCG. However, under Nonstationary shifts, the Dynamic bias controller degrades markedly on Mean window MGU@10 (0.03939 vs. 0.02750, a 43.2% higher local deviation than ELGAR) and yields 8.7% lower Tail NDCG. This gap stems from how each method utilizes the ledger state: a linear deficit rule applies a uniform score offset regardless of user preferences, causing lag or over-correction when request distributions alternate, whereas ELGAR fuses the ledger with request representations through a neural network to adjust group routing smoothly across shifting user contexts.
We have added this analysis to Section 4.4 and provided the full setup and metric trajectories in Appendix M of the revised manuscript.
Response to Reviewer FBdx - Part 3/6 (Q2)
Q2: Clarify Appendix J.2's state-sufficiency claim under the vs. counterexample and assess the impact of omitting total exposure counts.
R2:
We thank the reviewer for the concrete counterexample and for asking us to clarify the state-sufficiency claim in Appendix J.2. The counterexample occurs when adding one Tail exposure overshoots the target and yields a larger deviation than adding one Head exposure. To formalize this, we derived the exact analytical conditions under which omitting the exposure total changes the preferred one-step group action. We confirm that the clipped ledger is an approximate state representation past the warm-up horizon, and prove that the preferred action depends on the exposure total only within this narrow overshoot regime. Outside this regime, the clipped ledger preserves the exact exposure-imbalance direction without needing the cumulative exposure total.
The two count vectors have the same exposure proportions, with Head over-exposed and Tail under-exposed. However, Eq. (8) selects the group that leaves the smaller deviation after adding one exposure, and the effect of this addition depends on the total exposure count . At , adding one Tail exposure overshoots the target and produces a larger deviation than adding one Head exposure. At , adding one Tail exposure reduces the deviation without overshooting. The precise conditions are as follows.
Exact condition for disagreement when
Let , , and . Since ,
D=2|d|,\qquad r(g)=2|d|-2|d'_g|. \end{equation}$$ The deviations after adding one Tail or Head exposure are $$\begin{equation} d'_T =d-\frac{\rho_H}{{N_{\mathrm{exp}}+1}}=\frac{{N_{\mathrm{exp}}d-\pi_H}}{{N_{\mathrm{exp}}+1}}, \end{equation}$$ $$\begin{equation} d'_H = d+\frac{\rho_T}{{N_{\mathrm{exp}}+1}} = \frac{{N_{\mathrm{exp}} d+1-\pi_H}}{{N_{\mathrm{exp}}+1}}. \end{equation}$$ Therefore, $$\begin{equation} |d'_H|^2-|d'_T|^2 = \frac{{2N_{\mathrm{exp}} d+1-2\pi_H}}{{(N_{\mathrm{exp}}+1)^2}}. \end{equation}$$ Eq. (8) strictly prefers Head if and only if $$\begin{equation} d < \frac{2\pi_H-1}{{2N_{\mathrm{exp}}}}. \end{equation}$$ Consequently, when Head is over-exposed ($d > 0$), **a strict disagreement with the underexposure direction occurs if and only if $d$ falls inside the narrow range** $$\begin{equation} \boxed{ 0 < d < \frac{2\pi_H-1}{{2N_{\mathrm{exp}}}}. } \end{equation}$$ **At equality, both actions yield the same gain. Outside this range ($d \ge \frac{2\pi_H-1}{2N_{\mathrm{exp}}}$), Tail remains the preferred action.** This disagreement happens only when adding Tail overshoots the target severely. Specifically, adding Tail crosses the target ($d'_T < 0$) whenever $d < \pi_H / N_{\mathrm{exp}}$. Within this overshoot region, two regimes arise: - **Severe overshoot ($0 < d < \frac{2\pi_H-1}{2N_{\mathrm{exp}}}$):** The Tail overshoot $|d'_T|$ exceeds half the step separation $\frac{1}{2(N_{\mathrm{exp}}+1)}$, leaving a larger deviation than adding Head. Thus, Head is preferred. - **Mild overshoot ($\frac{2\pi_H-1}{2N_{\mathrm{exp}}} \le d < \frac{\pi_H}{N_{\mathrm{exp}}}$):** Adding Tail crosses the target slightly, but still produces a smaller deviation than adding Head. Thus, Tail remains preferred. When $d < 0$, Head is under-exposed. Because $(2\pi_H-1)/(2N_{\mathrm{exp}}) > 0$, the condition $d < (2\pi_H-1)/(2N_{\mathrm{exp}})$ always holds, so Head is always preferred without disagreement.
Response to Reviewer FBdx - Part 1/6 (W1 & Q1)
Thank you for recognizing ELGAR’s strengths and for your constructive suggestions; we added controlled experiments, theoretical analysis, and multi-permutation evaluations to address all points below.
R1:
We appreciate the reviewer’s suggestion to isolate the contribution of adaptive exposure feedback through fixed-ledger and relevance-aware controls. To separate adaptive exposure feedback from static group bias and rule-based deficit heuristics, we evaluated ELGAR by freezing or removing only the ledger input (four static controls) and comparing against a relevance-plus-exposure-deficit controller (Dynamic bias controller) at the same group-token step on Beauty with TIGER. ELGAR achieves tighter local fairness alignment than all four static controls across both request settings, and outperforms the Dynamic bias controller under nonstationary shifts without sacrificing overall utility. Although both ELGAR and the Dynamic bias controller track cumulative exposure deficits, ELGAR fuses ledger states with user representations via a neural fairness head instead of applying a rigid linear offset, enabling smoother adaptation when request mixes shift.
We compare ELGAR with five control policies: Static Bias, fixed Head-, Tail-, and zero-deficit ledgers, and the Dynamic bias controller. All policies reuse the same trained Beauty-TIGER checkpoint without retraining, preserving the group-token generator, fairness head, and training supervision. Static Bias retains request-dependent fairness scores and replaces the ledger contribution with a constant Tail-group logit offset b; the three fixed-ledger controls keep the ledger input fixed to states representing Head underexposure, Tail underexposure, or target alignment. The Dynamic bias controller retains the same request-dependent scores but replaces the learned ledger contribution with an offset proportional to the current cumulative Tail-exposure deficit, scaled by αctrl. Both bias controls act at the same group-token step as ELGAR. Here, λdec is the inference-time weight controlling the strength of the ledger-guided fairness intervention. All policies and parameters were tuned on the validation set. Statistics were computed per nonstationary order, then averaged over five orders from five random seeds (2026-2030).
We conduct the experiments on Beauty with TIGER and test the effectiveness in two situations. Default uses the original test order in our paper; we add a Nonstationary situation in which we reorder the same requests into eight alternating Head- and Tail-leaning blocks using visible user histories to test adaptation to changing request mixes.
Evaluation metrics. As each stream contains multiple requests, we use Full-stream MGU@10 to measure aggregate exposure deviation from the target across all requests. Mean window MGU@10 averages the deviations computed within complete trailing 500-request windows; lower values mean closer average alignment as request mixes change.
Table R1. Routing-control comparison on Beauty-TIGER under Default and Nonstationary request orders.
Within each Test order setting, bold marks the best value and underlining marks the second-best value for each metric. ↑/↓ indicates whether higher/lower is better.
Table R1.1. Default.
Bold: best; underline: second best.