- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies sequential pricing in which a seller jointly chooses a price and an LLM-generated product advertisement, using binary purchase feedback. It proposes a LoRA-based actor–critic method: a demand critic guides price selection and provides a leave-one-out baseline for KL-regularized policy-gradient updates to the advertisement generator. The method is evaluated on three synthetic demand models and a marketplace demand simulator.
Critical strengths
-
The paper formalizes the interaction between language generation and pricing, rather than treating ad generation as an isolated reward-modeling problem. Sections 2 and 3 clearly specify the information structure, LoRA-restricted actor, demand critic, and pricing rule, making the setting and optimization target concrete.
-
The actor update is well justified for the stated batch-frozen pricing policy. Proposition A.1 proves that the gradient of the surrogate in Algorithm 1, Line 11 is an unbiased estimate of the gradient of the batch-specific KL-regularized objective , including the critic-based leave-one-out baseline. The experiments also transparently evaluate expected revenue using the known synthetic demand model or frozen simulator, rather than relying only on noisy realized revenue, as described in Equation 12 and Tables 1–2.
Critical weaknesses
The experiments do not isolate whether the reported gains come from the proposed joint actor–critic procedure or from evaluating the adapted actor with a critic trained on that actor’s generated-text distribution. In Section 4, “Reference” uses the same final critic returned after online learning with the Trained actor. Because that critic has been updated on advertisements from the adapted policy, the Reference policy may be disadvantaged by critic extrapolation or less accurate pricing on reference-model texts. Conversely, the online comparison with UCB in Figures 2–3 is not matched: UCB neither uses the pretrained critic nor conditions its price on the generated advertisement, while the proposed method does. These comparisons show improvement over the paper’s stated reference protocol, but do not cleanly attribute the gain to joint optimization or establish that the actor–critic design outperforms reasonable decomposed alternatives.
This matters because the central empirical claim is that jointly adapting advertisements and prices is beneficial. A more diagnostic evaluation would include an advertisement-only LoRA baseline with a fixed or independently trained pricing rule; a critic-only, text-conditioned pricing baseline using the reference generator; and a reference-generator policy with a critic trained or updated on its own generated-text distribution under the same interaction budget. These comparisons should be reported across independent training seeds. Appendix B.1 states that the bootstrap intervals in Tables 1–2 condition on the trained policy and fixed simulator, excluding seed variation.
Questions for authors
-
In the final Trained-versus-Reference comparisons in Tables 1–2, did you evaluate a Reference generator paired with a critic trained or updated online on Reference-generated advertisements, using the same interaction budget? If so, please report the result. If not, this comparison would clarify whether the gains persist after accounting for potential critic–distribution mismatch.
-
How many independent actor–critic training seeds were run for each environment and marketplace category? Appendix B.1 states that the reported confidence intervals exclude variation across training seeds and simulator fits. Seed-level means and variation could therefore materially affect confidence in the reported effect sizes.
We thank the Reviewer for the time and consideration in reviewing our work. The reuploaded manuscript includes the new analyses and full result tables. All four synthetic settings and three of five Avito categories have complete comparisons with three seeds and shared offline initialization. Two categories remain unfinished. Within our computational resources, we share completed evidence now to allow time for Reviewer assessment.
Reference generator with its own critic. This comparison was absent from Tables 1-2. We now include it as pricing-only: the reference generator remains frozen (ητ=0 in Algorithm 1), while its own text-conditioned critic is updated on its own generated advertisements and purchase feedback. Joint and pricing-only share the offline initialization, price grid, exploration rate, and budget of 16,000 online observations. Reference thus uses its own critic rather than Joint's final critic. Across the four synthetic settings, average normalized revenue is 0.15913 ± 0.00127 for Joint versus 0.13369 ± 0.00254 for pricing-only. Across the completed Avito categories, it is 0.21352 ± 0.00645 versus 0.20701 ± 0.00033, respectively. These are means and sample standard deviations across the three training seeds. Joint's positive average differences thus persist in the requested comparison.
Independent training seeds and simulator fits. The original bootstrap intervals conditioned on one online-trained policy per setting. We now run three independent online training seeds (47, 83, 131) per method and environment/category, conditional on the shared offline initialization. The revised tables report individual-seed results, means, sample standard deviations, and paired differences. The averages above weight contexts equally within each seed. Generated ads and bootstrap resamples are not additional training replicates. Separately, we rescored frozen Avito advertisements at unchanged prices under three independently refitted simulators, using the same architecture and historical splits. Joint's positive average differences against pricing-only, sequential, and Independent persist in every refit. Its ranking against advertising-only changes. These refits assess sensitivity to simulator fitting and are not additional policy-training seeds.
Decomposed alternatives and price-content interaction. We added advertising-only and sequential as restricted configurations of Algorithm 1, and an independent control combining separately trained components. Advertising-only learns ads at a fixed price with a frozen critic. Sequential trains the components in successive phases. Each receives 16,000 total online observations, divided between components for sequential and independent. Joint's average gains over Sequential and Independent are respectively 3.45% and 0.79% on synthetics, and 6.78% and 4.73% on Avito.
When it comes to advertising-only, this one is highly competitive as its average normalized revenue is 0.15864 on synthetics and 0.21543 on Avito categories. It retains the advertising-learning component of Algorithm 1 while fixing an optimized initial price pˉ. Formally, it is recovered by setting ετ=1, ντ=δpˉ, and freezing critic updates (γτ=0), retaining pˉ at evaluation. Its average revenue exceeds pricing-only by approximately 18.7% on synthetics and 4.1% on Avito. This identifies a competitive configuration of Algorithm 1 retaining the proposed advertising-learning component. Furthermore we chose to: (1) employ a pretrained critic for every specification of Algorithm 1 and (2) sample multiple ads to allow the advertising-only agent to exploit such critic much more heavily than joint (through a Monte Carlo estimate over multiple ads, whereas joint conditions its price on each individual advertisement). In a fully online setting from scratch, however, such a price would have to be selected using a randomly initialized, unfitted critic. We opted for this approach due to time and computational constraints, as we think it is the fairest and strongest amidst others, but we commit to provide an even more insightful ablation (data scarcity progression) in the final version of the paper.
We also added Text-crossing, extending the original synthetics with two interacting text features whose preferred combination changes with price; the demand coefficients remain unknown to the learner.
UCB and information matching. UCB lacks supervised critic pretraining and advertisement-conditioned pricing, so it is secondary. Our primary comparisons use matched ablations and Independent; pricing-only shares the pretrained critic initialization and learns its own text-conditioned critic online.
Please let us know if further discussion is necessary. In case we properly addressed the Reviewer's concerns we would be grateful if the Reviewer could revise the evaluation.