- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Targeting proactive retail assistance, this paper proposes a three-stage See–Foresee–Act framework instantiated as the PIWM model. The See module extracts customer behavioral evidence from sparse videos, and outputs a structured customer representation with both explicit observation fields and inferred states, integrating the AIDA purchasing stage model and the BDI cognitive framework. Conditioned on the current state, the Foresee module predicts one-step normative consequences (including next-stage state, expected benefits and risks) for five candidate actions: Greet, Elicit, Inform, Recommend, and Hold. The Act module outputs the final intervention decision by explicitly comparing predicted consequences across all candidates. In addition, the authors construct GuidanceSalesBench, a benchmark consisting of rule-guided hierarchical synthetic annotations and a small set of real-store samples, supporting both component-level evaluation and end-to-end full-pipeline assessment. Experimental results show that the consequence-based decision paradigm achieves an 18.27% accuracy improvement over direct action output from states, and verify the positive effects of explicit evidence retention and non-intervention consequence modeling on decision performance.
Overall, this work delivers a systematic pipeline design and benchmark construction for proactive retail assistance with sound engineering completeness. However, debatable issues remain regarding the rigor of core concepts, the increment of academic novelty, and the rigor of experimental design.
Critical strengths
1.Systematic solution design for retail scenarios This work clarifies the task definition and decision boundary of proactive retail assistance, and provides a complete structured pipeline from visual observation to intent modeling and intervention decision-making. It also includes non-intervention as an equivalent decision option in the framework. With self-consistent design logic, it has clear reference value for the development of retail intelligent customer service and in-store shopping guide systems.
2.Instrumental contribution of the hierarchically annotated benchmark GuidanceSalesBench adopts a four-layer annotation structure (observation-state-consequence-action), supporting independent evaluation and optimization of perception, prediction and decision modules. Different from traditional end-to-end datasets, it helps follow-up research accurately locate module bottlenecks and has good resource value for the field.
Critical weaknesses
1.Imprecise core concept definition with limited academic novelty and technical depth Terminology usage deviates from field consensus: the paper frames the single-step state classification Foresee module as a world model (Section 3.3) and labels candidate outcome comparison as counterfactual reasoning (Table 2), neither aligning with mainstream field definitions and indicating insufficient terminological rigor. Meanwhile, the overall framework is essentially a scenario transfer of the classic perception-prediction-decision pipeline. Both AIDA and BDI are well-established theories; the model only applies LoRA fine-tuning on a general large model (Section 3.5) and restricts the task to 5-way classification at a single decision point (Section 1), with no new theory or structural innovation proposed and limited academic depth.
2.Insufficient experimental rigor weakening credibility and generalizability of core conclusions First, benchmark annotations are rule-generated (Section 4.1), so model performance largely reflects fitting to annotation rules, with an unclear generalization boundary to real scenarios. Second, the evidence ablation modifies inputs to both Foresee and Act simultaneously (Section 5.3), and variable confounding leads to ambiguous attribution of performance changes. Third, test sample sizes differ between baselines and the proposed model in real-scenario evaluation (Appendix Table 10), with inconsistent comparison calibers, which undermines the empirical persuasiveness of the conclusions.
Questions for authors
-
Clarification on concept definition The paper refers to the Foresee module as a world model, but it only performs single-step structured state classification, which differs greatly from the mainstream world model paradigm of latent-space dynamics modeling and multi-step trajectory generation. How do the authors define the connotation of world model in this work? Have you considered adjusting the wording to better align with field consensus and avoid ambiguity? Please provide the necessary explanations or make the necessary revisions.
-
Generalization boundary clarification Section 4.1 states that core annotations of GuidanceSalesBench are generated from “27 compact principles and 78 source-linked conditional rules”, constituting rule-guided synthetic data, so model performance essentially reflects fitting to annotation specifications. To what extent do the authors believe conclusions from this dataset can be transferred to real retail scenarios? Are there further plans for real-scenario validation? Please provide the corresponding explanations.
-
Ablation experimental design As described in Section 5.3, the evidence ablation removes explicit evidence fields from inputs to both Foresee and Act and regenerates all candidate consequences, making it impossible to precisely locate the source of performance degradation. Have the authors supplemented a control condition where evidence fields are removed only from Act’s input while Foresee inputs remain unchanged? If not, do you acknowledge that the current attribution conclusion has ambiguity? Please provide the corresponding experiments and explanations.
-
Fairness of real-scenario comparison According to Table 10 in the appendix, baseline large models are evaluated on only 237 samples in the real-store experiment, while PIWM covers all 418. Test sample sizes differ between baseline models and PIWM. What are the filtering criteria for the 237 matched samples? Could you supplement PIWM’s accuracy on the same 237-sample subset to ensure fair horizontal comparison? Please provide the corresponding experiments and analyses.
-
Reproducibility details Section 3.5 only states that the model is implemented with a “Qwen2.5-VL-7B-Instruct backbone and LoRA adaptation” without specific configurations. Please supplement the complete training configurations and inference prompt templates for all three modules, including key hyperparameters such as LoRA target layers, rank, learning rate schedule, and training steps, to improve the reproducibility of the work.
2 comments
Thank you for the detailed response. The separate Foresee and Act ablations address my concern about attribution, and evaluating all three models on the same 418 records resolves my concern about the real-store comparison. The clarification of what Foresee predicts is also helpful. I see the paper’s main contribution in the retail decision task and its benchmark. Since the predicted consequences reflect rule-guided expectations, the contribution to modeling how customer intent changes after an intervention remains limited. I therefore maintain my original rating.
# Response to Reviewer jHKL
We thank the reviewer for the careful reading.
Q1. Terminology. We use "world model" in its functional sense: a model that predicts the next state from the current state and an action. PIWM is an intent world model. Its state is the customer's intent state (AIDA stage and BDI) rather than pixels or a learned latent, and Foresee predicts how this state changes under each candidate action. It therefore differs from latent-dynamics world models in its state space and horizon, but in essence it performs action-conditioned next-state prediction. We will state this definition and its scope (structured intent state, one-step horizon) explicitly in Section 3.3. Likewise, "counterfactual" refers to comparing the predicted consequences of alternative candidate actions from the same current state; we will define it at first use.
Q2. Generalization boundary. The conclusions are drawn in the rule-guided synthetic setting. Results on the 418 Real records for all models are given below.
Q3. Evidence ablation. We ran the requested control: the four evidence fields are removed from one module at a time.
Evidence contributes through both modules, with the larger share through Act.
Q4. Fairness of the real-scene comparison. All models are now evaluated on the same 418 Real records: GPT-4o 39.71%, Gemini 2.5 Flash 40.91%, PIWM 63.16%.
Q5. Reproducibility.
The prompt templates of the three modules are identical in training and inference and will be listed verbatim in the appendix together with the released code.