- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper is about GEO by rewriting source documents to increase their visibility in generative search while preserving their content. It trains a rewriter using a reward that combines visibility relative to the strongest competing source with a faithfulness score. The main change to GRPO is to compare each sampled rewrite's reward with the original document's reward, while retaining normalization by the sampled group's standard deviation. The paper also extracts editing guidelines from successful rewrites for use with an off-the-shelf LLM. Experiments on three GEO benchmarks report improved visibility and faithfulness over several rewriting baselines.
Critical strengths
- The proposed optimization strategy by comparing rewrites with the original document is a good choice for the GEO task. The controlled GRPO comparison reports improvements in both visibility and faithfulness.
- The experiments are pretty thorough, including model-size ablations, transfer across generative engines, and a useful demonstration that successful edits can be distilled into reusable instructions.
- The provided repository contains the necessary code and scripts for auditing.
Critical weaknesses
I find the intellectual and technical contribution fairly narrow.
-
The main technical idea is a simple tweak to GRPO: replace the sampled group mean reward with the original document's reward when computing advantages, while keeping the same normalization. AutoGEO already combines GRPO with a semantic-preservation reward.
-
The empirical improvements are modest. At the same 1.7B model size, RAPO improves visibility over AutoGEO-Mini by only 0.33 and 0.78 points on GEO-Bench and Researchy-GEO, respectively. Under the controlled GRPO comparison, the gains are 1.48 and 1.16 points on the reported 0–100 scale. The faithfulness scores have bigger margins, but the main metric for GEO seems to be visibility...
Questions for authors
-
Why should comparing rewrites with the original document lead to better learning than comparing them with each other (i.e. GRPO)? Could you provide some technical or theoretical justification?
-
Could RAPO score better simply by removing important information and making the remaining text easier to cite? Do the resulting generative search results actually become better?
6 comments
Author Response for Reviewer B5DA (2/4)
-
Faithfulness reward: markedly more effective at semantic preservation than AutoGEO's heuristic reward. AutoGEO-Mini is a Qwen3-1.7B model fine-tuned with GRPO using a heuristic, rule-based reward (Sec. 4), which checks for semantic preservation without verifying individual claims. RAPO's faithfulness term F(x̃, x; J) instead is computed by an LLM judge in two steps (Appendix A.2): it first extracts the factual claims in the rewrite, then checks each claim against the original source, and the score is the fraction of claims verified as consistent with it. This claim-level check is applied to every sampled rewrite during training, so unsupported additions are penalized directly in the reward, rather than only caught when they happen to violate a fixed heuristic rule. Our qualitative analysis (Appendix A.10, Table 17) shows exactly this difference in practice: on the same source document, RAPO's rewrite preserves every cited figure and still gains +18.4 visibility, while AutoGEO-Mini's heuristic reward lets it fabricate a purity-grading table with invented grades and symbols ("Coiny," "PM") and a false "penny gold" statistic, losing -24.7 visibility. At the same Qwen3-1.7B scale, this gap holds in aggregate too: RAPO reaches 75.90 and 75.71 faithfulness on GEO-Bench and Researchy-GEO, versus 63.27 and 61.38 for AutoGEO-Mini (+12.63 and +14.33 points).
-
Reference-anchored advantage: an empirical and conceptual improvement over GRPO. Reference-anchoring gives the largest faithfulness gain (+2.09 and +2.28 points) and also improves overall visibility (+1.48 and +1.16 points), since each rewrite is scored, and penalized for drifting, against the source's own reward; the faithfulness term reinforces this same objective. The GRPO variant in the second row isolates just this centering change, since it already shares RAPO's full composite reward, including competition-aware visibility and faithfulness (Table 3), and differs only in how the advantage is centered. Two points show the centering still matters on its own. First, RAPO still outperforms this variant, as well as Dr. GRPO, DAPO and Reinforce, on both metrics despite the identical reward, so the gain must come from centering, not the reward. Second, centering changes what the advantage means: group-mean centering only signals whether a rewrite beat its sampled peers, while reference anchoring signals whether it improved on the source (Eq. 7), so a group where every rewrite regresses yields no positive advantage at all (Sec. 3.2).
Thus the three components (competition-aware visibility, the reference-anchored advantage, and the faithfulness reward), taken in combination as well as individually, and including a faithfulness mechanism that is both conceptually distinct from and empirically stronger than AutoGEO's rule-based approach, together constitute the paper's technical contribution. We have included this component ablation in Appendix A.5 (Table 10), referenced from the main paper.
Q1: Theoretical and empirical justification for reference-anchoring over group-mean centering (GRPO)
Q1 - "Why should comparing rewrites with the original document lead to better learning than comparing them with each other (i.e. GRPO)? Could you provide some technical or theoretical justification?"
Group-mean centering tells a rewrite only whether it beats the other sampled rewrites in its group, not whether it improves on the source. Because centering is relative to the group's own mean, a group still splits into above-mean (positive advantage) and below-mean (negative advantage) rewrites even when every rewrite in that group agrees in direction relative to the source, i.e., all of them improve on it or all of them regress from it. This gives two failure cases:
- All rewrites are worse than the source. The above-average rewrites still regress, yet they receive positive advantage and are reinforced. For example, with a source reward of 0.50 and rewrite rewards of 0.30, 0.35, 0.40 and 0.45 (group mean 0.375), GRPO reinforces the 0.40 and 0.45 rewrites even though both are worse than the source.
- All rewrites are better than the source. The below-average rewrites still improve on the source, yet they receive negative advantage and are suppressed.
In both cases the update points the wrong way relative to the actual objective (improve over the source), because the comparison target is the sampled group. Source anchoring removes this by construction: Âᵢ > 0 iff rᵢ > r̄(x,q) (Eq. 7), so a rewrite is reinforced only if it improves on the source. Because r̄ is a fixed reference and not a statistic of the current policy, it does not rise as the policy changes, whereas the group mean moves with the policy and always produces roughly half positive and half negative advantages regardless of absolute progress.
Author Response for Reviewer B5DA (3/4)
W2: Visibility and faithfulness gains are joint and consistent at matched scale and under the controlled GRPO comparison
W2 - "The empirical improvements are modest. At the same 1.7B model size, RAPO improves visibility over AutoGEO-Mini by only 0.33 and 0.78 points on GEO-Bench and Researchy-GEO, respectively. Under the controlled GRPO comparison, the gains are 1.48 and 1.16 points on the reported 0–100 scale. The faithfulness scores have bigger margins, but the main metric for GEO seems to be visibility..."
In both of the settings i.e. the matched-scale comparison against AutoGEO-Mini and the controlled GRPO comparison, comparisons should be read and interpreted as joint gains in visibility and faithfulness. RAPO improves Overall Visibility and also improves faithfulness with good margins as discussed below -
- RAPO outperforms AutoGEO-Mini at matched 1.7B model scale (Tables 1 and 6): Both methods use the same Qwen3-1.7B backbone here, isolating the effect of RAPO's reward/advantage design from any difference in model scale. RAPO improves Overall Visibility over AutoGEO-Mini from 23.88 to 24.21 on GEO-Bench (+0.33 points; +1.4% relative gain) and from 30.59 to 31.37 on Researchy-GEO (+0.78 points; +2.5% relative gain). Measured against the unoptimized source (Vanilla), RAPO's relative visibility gain is +59.2% vs. AutoGEO-Mini's +55.3% on Researchy-GEO, and +24.2% vs. +22.5% on GEO-Bench. Faithfulness improves over AutoGEO-Mini from 61.38 to 75.71 on Researchy-GEO (+14.33 points; +23.3%) and from 63.27 to 75.90 on GEO-Bench (+12.63 points; +20.0%).
- Controlled GRPO comparison (Table 3, same reward, backbone and training setup): Under this matched setup, RAPO improves Overall Visibility over GRPO from 27.36 to 28.84 on GEO-Bench (+1.48 points; +5.4% relative gain) and from 34.36 to 35.52 on Researchy-GEO (+1.16 points; +3.4% relative gain). Faithfulness improves over GRPO from 75.36 to 77.45 on GEO-Bench (+2.09 points; +2.8%) and from 78.04 to 80.32 on Researchy-GEO (+2.28 points; +2.9%). Both methods substantially outperform the unoptimized source (Vanilla) on visibility, and RAPO's margin over Vanilla is larger than GRPO's: +47.9% (RAPO) vs. +40.3% (GRPO) on GEO-Bench, and +80.3% (RAPO) vs. +74.4% (GRPO) on Researchy-GEO.
Regarding "the main metric for GEO seems to be visibility": we agree that visibility is GEO's primary task-level objective, but optimizing it in isolation can degrade faithfulness. Raising citation likelihood changes the content, and without a faithfulness signal those changes need not preserve the meaning, facts and claims of the original document. Several of our baselines show this pattern: Statistics Addition and Quotation Addition raise visibility over Vanilla but reach only 62.30 and 72.15 faithfulness on GEO-Bench, and AutoGEO-Mini reaches 63.27. The goal stated in Section 1 is therefore to improve visibility keeping faithfulness intact as much as possible, and RAPO's results should be assessed on both axes together. A method that increases visibility while also improving faithfulness over its matched baselines addresses this goal more fully than a visibility gain alone. Reference-anchoring is also one of three contributions (with competition-aware visibility and the faithfulness reward, addressed in W1 above), so its standalone visibility margin should be read alongside the separately ablated visibility contribution of competition-aware visibility (+2.59 and +2.83 Overall Visibility points).
Q2: RAPO's gains are not from deleting information, confirmed via a direct baseline comparison which simplifies content
Q2 - "Could RAPO score better simply by removing important information and making the remaining text easier to cite? Do the resulting generative search results actually become better?"
To test this, we refer to a baseline already in our main results: GEO-Bench's "Easy-to-Understand" strategy (Table 1), which simplifies the source language into shorter, easier-to-cite text. This is the baseline corresponding to the omission-driven visibility gain the reviewer describes, and it performs much worse than RAPO: simplification alone yields a much smaller visibility gain than RAPO at comparable faithfulness, so a strategy built around shrinking content is itself an inferior way to gain visibility. Moreover, RAPO's Word and Pos scores rise rather than fall, which indicates that RAPO's own gains are not coming from shrinking content either. We report the numbers (from Table 1) in the following table:
Answer to be continued ...
Author Response for Reviewer B5DA (1/4)
We thank the reviewer for the positive assessment and for recognizing that comparing rewrites to the original document is a good fit for GEO, that the controlled GRPO comparison improves both visibility and faithfulness, and for the thoroughness of our experiments, including model-size ablations, generative-engine transfer, and the provided code repository. Below, we highlight RAPO's novel technical contributions beyond reference-anchoring with a component-by-component ablation (W1), give the theoretical and empirical justification for source-anchoring over group-mean centering (Q1), clarify how to read the visibility and faithfulness margins together under matched scale and controlled GRPO comparisons (W2), and rule out omission-driven visibility gains with a direct baseline comparison (Q2). We hope these address the reviewer's concerns and would welcome any further questions.
W1: RAPO's three technical contributions each measurably contribute, beyond a single centering-term tweak
We would like to note and highlight that RAPO's proposed approach has three novel technical contributions, not one: (i) a competition-aware visibility formulation that scores a rewrite relative to the other sources competing for the same result slot, (ii) a faithfulness reward and metric that explicitly checks rewrites against the source, and (iii) a reference-anchored advantage that centers learning on the source document itself rather than on sampled peer rewrites. The table below ablates each one separately on a fixed Qwen3-8B backbone, changing only the named component per row while holding the other two fixed, and we discuss each contribution afterward in light of this table, empirically and in contrast to related methods.
Answer to be continued ...