My main concern is that it is unclear how much the router uses the prompt. The router scores a fixed population, and viewpoint structure may be largely stable across prompts, for example if the same individuals tend to be outliers or centers. A single learned ranking that ignores the prompt, such as the same MLP with a constant input or a free logit vector trained with the same reward, could then capture much of the gain, but no such baseline is reported. The Remesh test prompts are also close to the training prompts, since the 1,000 generated questions cover ten topics and are split at random (Appendix D.1.1). Without a prompt-agnostic baseline or a prompt-sensitivity analysis, such as the overlap of top-k sets across prompts or a topic-held-out split, one cannot tell whether RL-SCA learns prompt-dependent routing or a good population-level ordering.
The results also lack a reference point and an ablation of the reward. For mPJR+, SEAR applied to the generated embeddings satisfies the axiom by construction (Section 1), but for mEJR+ there is no reference such as a greedy or local-search minimizer of β⋆, so it is unclear how much headroom remains or how often mEJR+ is satisfiable at all on these instances. The central design choice is also not ablated: a binary mEJR+ or mPJR+ reward versus the graded −logβ⋆, or other transforms of β⋆. The sparse-reward argument for a graded signal is plausible but not tested empirically.
The comparison with PRS partly favors RL-SCA by construction, and PRS details are missing. RL-SCA is trained on the mEJR+ factor computed in the same generated embedding geometry used for evaluation, and mEJR+ implies mPJR+, whereas PRS is trained to predict embeddings; the authors acknowledge this for the mEJR+ comparison (Appendix D.4). This alignment is partly the point of end-to-end training, but the paper does not describe how the PRS predictor was trained or tuned on each dataset. This matters most for Humanual Book, which uses a different simulator from Kraiczy et al. RL-SCA was tuned over 18 configurations on Remesh and 4 on Humanual Opinion (Appendix D.3), and it is not stated whether PRS received comparable tuning.
The efficiency claim is not measured. Single-forward-pass inference is a headline claim, yet the paper reports no wall-clock, FLOP, or latency comparison with PRS, and SAGE still requires k LLM simulation calls, so the practical saving should be quantified. The offline cost of generating the full response grid for every training prompt (155,000 responses for the 500 Remesh training prompts) is also not compared with what PRS requires.
The router's scope is limited, and the evaluation measures only a proxy. With one output per simulation, the model is tied to a fixed population of at most 310 individuals; it cannot add new individuals or select from subpopulations, and it does not use the individual-level context si that PRS uses. The authors list these as future work (Section 4), but they matter for SAGE, where the target population depends on the prompt. In addition, all results are measured in the preference-embedding geometry, and there is no test of whether better proportionality leads to better SAGE outputs, for example syntheses judged against the synthesis from the full population.
Minor comments: all reported hyperparameter sweeps use training seed 0 and no variance across seeds is reported, and with 80 test prompts on Humanual Opinion the binomial intervals in Figure 1 are about ±10 percentage points. The contributions mention “three baselines”, but only PRS and random selection are evaluated. The training configuration for Humanual Book is not reported (Table 3 and Appendix D.3 cover only Remesh and Humanual Opinion). The paper also does not state which mPJR+ verifier is used for evaluation, whereas Kraiczy et al. used the FPT verifier with subsampling.
Overall, the paper offers a clean and reusable idea, an exactly computable proportionality reward, with sizeable gains at k=10. The evidence would be more convincing with a prompt-agnostic baseline, a reference point for mEJR+, details and comparable tuning for PRS, and measured efficiency. I currently lean toward rejection, but would raise my score if these additions, especially the prompt-agnostic baseline, show that the router learns prompt-dependent selection.