acceptodds
Under review as a conference paper at ICLR 2027

ConGUIBench: Controlled Diagnostics for Multi-Constraint GUI Agents

Abstract

Reliable multi-constraint execution requires graphical user interface (GUI) agents to distinguish goal wording, requested procedure, and realized task state, distinctions that terminal success alone cannot reveal. We introduce ConGUIBench, comprising 118 two- to four-constraint shopping and travel tasks across four web platforms. Controlled Non-Procedural Goal (NPG) and Explicit Procedure (EP) variants, together with state interventions, evaluate goal invariance, procedural controllability, and state adaptivity. Across nine open-weight models on 118 tasks each, five sampled executions per instruction show that reordering equivalent NPG requirements produces 2.8–14.0% of excess cross-order success disagreement beyond same-instruction variability. Under EP, models match the requested order in 79.6–96.0%, yet only 17.6–63.6% of executions both follow the order and succeed. Cross-condition analysis shows that EP sharpens instruction-specific route alignment and increases ISR for eight of nine models, but the completion gains are modest. Agents also respond to visible progress, but suppressing one otherwise valid action lowers paired completion for every model; Oracle state information reduces this loss for most models. An auditor-maintained constraint checklist raises model-equal ISR by 3.7 points under EP and 9.2 points under NPG while also reducing across-run variability on average, highlighting constraint-state tracking as an important reasoning bottleneck. These results expose unstable goal execution, conditional procedural control, and brittle recovery, motivating their separate evaluation in GUI agents.

Primary area:
datasets and benchmarks
Keywords:
GUI Agent, Multi-constraint, Evaluation

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_fgPkOpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
1
Soundness
2
Read review
Paper summary

The paper introduces ConGUIBench, a controlled benchmark of 118 shopping and travel tasks on four real platforms (Amazon, JD, Booking, XieCheng) in two languages, with 688 non-procedural (NPG) and 688 matched explicit-procedure (EP) instructions, 2-4 constraints per task and a validated graph of 901 GUI states and 1,148 transitions. It asks a question that terminal success alone cannot answer: whether GUI agents are invariant to equivalent goal wording (goal invariance), follow an explicitly requested order (procedural controllability), and adapt to realized task state (state adaptivity). Across nine open-weight models, the authors find cross-order disagreement in outcomes across semantically equivalent instructions; that agents largely follow a requested order when they reach constraint, so failures stem mainly from execution rather than procedure following, with grounding misses named as the largest error type. The studies conducted by authors also find useful insights into agent performance using SLMs, for example Agents respond to visible progress i.e. when some constraints are already satisfied at the start, the agent's first action more often targets a pending constraint. Overall, the benchmark's dual-annotator validation is commendable and instills confidence in the quality and fidelity of the benchmark. Furthermore, there is a lot to learn from the studies and ablations done in this paper.

However, some claims might have been overstated in the paper and certain evaluation protocol have some inconsistencies which raises concerns about the validity of some results. For example, the benchmark has setup an offline graph-based execution of agents which has a strict range of valid click actions. Any click outside the annotated graph ends the episode, due to which valid but unannotated actions count as failures, so reported success rates may underestimate agent ability by an unknown amount (Detailed in W2). Further, several ordering ablations rely on the fact that all permutations have equal difficulty. However, that may not be the case as ordering of contraints in physical layout matters and some orders might be simply easier to execute on the page (W4). Finally, the scope of the benchmark seems quite small and limited due to length and difficulty of tasks (discussed at length in W2) and the eval experiments only cover open-weight models up to 32B, so the frontier on ConGUIBench is unknown, and the paper's own scale trends suggest several of the reported deficits, including order sensitivity, may shrink in larger models (W1).

Due to these reasons, and many more highlighted in the weakness and questions sections, the review rating is a weak reject.

Critical strengths

Overall, useful study of GUI capability gaps for Small-to-medium SLMs

S1 Dual-annotator quality control of every instruction and transition Each instruction realization is independently reviewed by two annotators, who check that it contains the intended constraint set in the specified mention order while preserving the goal semantics and instruction is retained only when both annotators approve. Every state transition is also inspected by both annotators (source state, assigned constraint, click region, and resulting state), and disputed regions or transitions are corrected and independently reviewed again. The authors further verify that every nonterminal state has an outgoing transition. This level of vetting across all 688 instruction pairs and 1,148 transitions gives confidence in the benchmark's labels.

S2 Well-thought ablations The study varies one factor at a time along many axes, while holding the constraint set fixed: the wording of the instruction (every permutation of the mention order), its format (non-procedural NPG vs. explicit-procedure EP), the starting state of the task (no constraint satisfied vs. some already satisfied), the outcome of an action (normal vs. a valid click that fails to take effect), the state information given to the agent (instruction only vs. Oracle satisfied/pending labels vs. an auditor-maintained checklist), and the source of the constraint list (ground truth vs. parsed). Results are further broken down by platform, language, and model family and size. Along these axes, the authors examine several distinct kinds of trends: how stable success is across equivalent wordings, whether agents follow a requested order, which route agents actually take and how consistent that route is across runs, whether agents redirect their actions after visible progress, how much completion they lose when an action fails, which types of errors end an episode, and how much outcomes vary across repeated runs. Covering this many angles gives a far more complete picture than a single success rate. The error-type study (Table 6) was also quite insightful as shows that grounding near misses are the largest named error type (27.6–28.7%) and are not reduced by EP, while EP does reduce completed-target repetition and premature selections. This breaks failures that ISR lumps together into distinct causes and makes the result actionable: click-level grounding, rather than procedure following, is a key bottleneck to address.

S3 Well-Designed metrics The metrics are also well chosen: CSR vs. ISR separates partial from full completion, and COCR vs. SOCR separates order adherence from success. Δ_order metric is unbiased and principled as the authors designed a noise-corrected estimator to study mention order sensitivity. By subtracting the disagreement between repeated runs of the same instruction from disagreement between runs of different order, it's expectation equals mean squared difference in success probability between orders, so it is unbiased and has expectation exactly zero when order has no effect.

Critical weaknesses

W1 - No frontier or larger models are evaluated, so the frontier (i.e. ISR) on ConGUIBench is unknown; The applicability of trends like cross-order disagreement, sharpening of route-alignment, constraint-state tracking reduces variability, etc on larger models is also unknown.

  • The evaluated set stops at 32B. All nine models are open-weight and range from 2B to 32B (Qwen3-VL 2B/4B/8B/32B, GLM-4.6V-Flash, UI-Mate-9B/27B, UI-Venus-1.5-2B/8B; §4.2.1). No proprietary frontier model and no larger open-weight model is evaluated. §4.2.1 also states that “proprietary models are accessed through their official APIs from the same evaluation pipeline,” yet no proprietary results appear anywhere in the paper. Were such models run and their results left out, or is this sentence left over from an earlier version?
  • The conclusions are stated about GUI agents in general but the model size also matters. The abstract and conclusion attribute “unstable goal execution, conditional procedural control, and brittle recovery” to GUI agents, and name constraint-state tracking as “an important reasoning bottleneck.” The paper's own scale trend suggests some of these deficits shrink with size. Within Qwen3-VL, going from 2B to 32B, SAG rises from +8.8 to +18.9, the paired B−A completion loss shrinks from −12.2 to −4.4 (Table 5a), and the checklist gain falls from +9.5 to +2.1 under EP and from +14.9 to +7.9 under NPG (Table 7). Without stronger models, it is unclear whether these are lasting properties of GUI agents or limitations of small models that disappear at scale.
  • Order sensitivity itself appears to shrink with scale. Reading Fig. 2 (values approximate), the largest model in each family has the lowest Δ_order within that family: Qwen3-VL 2B ≈ 8.7, 4B ≈ 9, 8B ≈ 14, 32B ≈ 6; UI-Mate 9B ≈ 4.7, 27B ≈ 2.8; UI-Venus-1.5 2B ≈ 6.1, 8B ≈ 4.9. If this trend continues, larger or frontier models may be largely insensitive to mention order, which would turn the paper's headline finding into a property of smaller models. Testing at least one larger model would show whether general capability gained through scale or pretraining makes agents robust to these instruction variations.
  • Headroom is not established. The best ISR is 56.7% under NPG (Table 2) and 66.8% under EP (Table 3), both from an 8B model. Without frontier results, readers cannot tell how much headroom the benchmark leaves for the strongest current agents, which matters for its usefulness going forward.
  • A missed opportunity. The benchmark's separation of goal invariance, procedural controllability, and state adaptivity is well suited to show which capabilities emerge with scale and which do not, e.g. whether larger models close the recovery gap but remain sensitive to mention order. This would be one of the most informative results the benchmark could produce, and the paper does not attempt it.
  • Suggested resolution. Evaluate at least one or two frontier proprietary models and the largest available open-weight model (e.g. Qwen3-VL-235B-A22B). If cost is a concern, a task subset with fewer samples per instruction would suffice. Then report, for each of Q1–Q3 and the checklist probe, which deficits narrow with scale and which persist. Otherwise, limit the claims to open-weight models of 32B parameters or fewer.

W2 - The benchmark's scope is narrow and its tasks are very short, and the offline evaluation protocol limits what the results can say about real GUI execution.

  • ConGUIBench has 118 tasks on four sites (Table 8), and 279 of its 307 constraints (90.9%) are filters. 93 tasks contain only filters. The benchmark therefore mainly measures multi-filter selection.
  • Extremely short horizons. Tasks average only 2.60 constraints (Table 8; 59 tasks have two, 47 three, and 12 four), and each constraint corresponds to a single annotated transition. A complete episode is thus two to four correct clicks. Findings about recovery, state tracking, and procedure following may not transfer to the long, multi-page workflows where these capabilities matter most.
  • An offline graph with strict termination. Agents do not interact with a live or replayed website but move through recorded screenshots; a click outside the candidate region of an annotated transition ends the episode. The potentially undestimates ISR (discussed in W3 in more detail)
  • The action space is unspecified. Only clicks are described. It is unclear whether agents can scroll or type, and this matters because “requires scrolling” is the largest subtype within Other errors (44.2% EP, 51.8% NPG; Table 6b): if scrolling is unavailable, these are limitations of the benchmark rather than agent failures.

W3 - Off-graph termination marks valid but unannotated actions as errors, and this directly lowers Success Rate!

  • The graph is admittedly incomplete, yet any click outside it ends the episode. The graph is “a validated representation of annotated feasible paths, not a claim that every possible interaction trajectory has been exhaustively enumerated” (App. B.2), but a click outside every annotated region terminates the episode with zero credit for the remaining constraints (§4.2; App. B.3). Exploratory clicks (e.g. opening a dropdown or expanding a filter panel) and equivalent but unannotated controls (e.g. the same filter in another panel) are therefore scored as failures.
  • This directly lowers ISR. ISR requires every constraint to be satisfied, so a single valid but unannotated click (e.g. opening a dropdown) ends the run and counts as a complete failure. Reported ISR may therefore underestimate what agents can actually do, by an unknown amount.

W4 - The Q1 order-sensitivity result cannot be attributed to mention order: reordering also changes the words in instruction because of unavoidable paraphrasing, and there is no paraphrase control to separate the two.

  • Reordering changes more than the order. The paper's own examples (Fig. 3) show it: “Find black Versace sunglasses for under 200”, “Find Versace sunglasses under 200 in black” and “Find black sunglasses, made by Versace, under 200” differ not only in constraint order but also in connective words (“for,” “in,” “made by”).
  • The baseline removes noise, not wording effects. Δ_order subtracts the disagreement between repeated runs of the identical instruction text (Eq. 9). This correctly removes sampling noise, but a positive Δ_order shows only that changing the text changes outcomes. It cannot say whether the change comes from the new order or from the new words. A model that is sensitive to any rewording would show the same result even if order played no role.
  • The claims attribute the effect to order. The abstract states that “reordering equivalent NPG requirements produces 2.8–14.0% of excess cross-order success disagreement,” and §4.3.1 speaks of “changes in success or satisfied constraints caused by reordering the same requirements.” The caveat in App. A does not reach these statements.
  • Suggested resolution: a paraphrase control. For each order, add two or three vetted paraphrases that keep the constraint order fixed and change only the surrounding connective words, exactly the kind of change reordering induces. The constraint phrases themselves should stay verbatim, as they do under reordering (e.g. keep “Versace sunglasses” and “under 200”; vary only connectives such as “for,” “in,” or “made by”: “Find sunglasses made by Versace, in black, under 200”). Compute Δ_paraphrase with the same estimator, using pairs of runs from different paraphrases of the same order as the between term. Δ_order − Δ_paraphrase then estimates the order-specific effect (assuming order and wording effects add), with the same task bootstrap. A full orders × paraphrases grid analyzed with a mixed-effects model would separate the two effects without that assumption. A subset of tasks, e.g. the 3–4 constraint ones, would suffice. Alternatively, rephrase the claims as sensitivity to rewording rather than to order only.

W5 - Q1's order sensitivity may reflect layout-driven route difficulty rather than unstable goal execution.

  • The layout imposes its own ordering. Constraints are physical controls on the page and since all orders take the same number of clicks, some orders are easier purely because of the layout (e.g. the next control on the layout matches the next constraint or stays visible without scrolling). An agent that follows the text will therefore succeed more often when the mention order happens to match the actual layout order, so Δ_order may measure route difficulty rather than “unstable goal execution” (abstract, §5).
  • Suggested resolution. Identify the easiest order per task from the recorded pages, report SR(mention order = easiest) − SR(otherwise), and test whether Δ_order remains positive after conditioning on the executed route.

W6 - The checklist experiment shows some gains, but those gains might be happening due to more than just checklist items

  • The checklist gives the agent more than progress marks. Besides the DONE/TODO labels, it also provides the goal already split into clean constraints, the auditor's notes on each constraint, and instructions such as "Do NOT repeat actions" (App. J.3). Any of these could explain the gain. Adding them one at a time would show which part actually helps.
  • The agent is never asked to keep its own checklist. To show that agents cannot track their progress, the authors would need to prompt the agent to write and update its own checklist. If that works as well as the auditor's checklist, the agents can track state; they simply weren't asked to.
  • The gains are small and have no error bars. Under EP, four of nine models gain at most 1.4 points or get worse, and the stability gain is just 1.1–2.0 points.
  • The auditor is never checked. A small 4B model fills in the DONE/TODO labels, but its accuracy is never measured, even though the benchmark has the true states to compare against.
Questions for authors

Q1 What actions are available to the agent? Only clicks are described. Can agents scroll or type, and how are the three form-value constraints (Table 10) entered? This matters for interpreting the error profile: "requires scrolling" is the largest subtype within Other errors (44.2% EP, 51.8% NPG; Table 6b). If scrolling is unavailable, these are artifacts of the benchmark rather than agent failures.

Q2 Is the Q1 order sensitivity explained by route difficulty? On a real web page, the order of the controls is fixed by the layout. Some completion orders are easier to execute than others, for example when the next filter stays visible without scrolling or the order of filters on the layout itself matches with the order in instruction. Since agents also tend to follow the order in which constraints are mentioned (Table 4), success may change across orderings simply because some orderings happen to match the actual layout order.

8 comments
AuthorsOpenReview ↗

Response to Reviewer fgPk

We thank the reviewer for the careful reading of our paper and the constructive feedback.

W1 Summary. Evaluate stronger proprietary and larger open-weight models to establish benchmark headroom and test whether the Q1–Q3 and checklist findings persist beyond the evaluated 2B–32B models, and clarify why the paper mentions API evaluation without reporting proprietary-model results.

R: We extend ConGUIBench to three API models: Doubao-Seed-2.0-Pro/Lite and Qwen3.7-Plus. On a fixed 36-task subset, the best ISR reaches 75.1% EP / 73.2% NPG, leaving substantial completion headroom.

Order and state sensitivity persist in API models. All three show positive Δstate with 95% CIs excluding zero; Δorder is also positive with CIs excluding zero for Lite and Qwen3.7-Plus. EP−NPG ISR intervals include zero for all three. These results extend the original diagnostics.

State-intervention results reveal model-dependent recovery. Across all starts, including inapplicable cases, the paired ISR loss is 9.4–20.9 pp for Pro/Lite (all four 95% CIs exclude zero), but only 2.8–2.9 pp for Qwen3.7-Plus (CIs include zero; revised manuscript, Appendix E.2, Table 18, all-start column). All six state-adaptation-gap intervals include zero. In the Oracle follow-up, gold state labels show no consistent mitigation: five of six mitigation CIs include zero, while Lite/EP shows a negative effect (−13.9 pp).

Overall, stronger API models still exhibit completion gaps, instruction sensitivity, and adaptation failures. These findings apply to the tested 36-task subset. Intervals use 10,000 physical-task bootstrap draws.

ModelISR EP/NPGEP COCRNPG ΔorderNPG Δstate
Doubao-Seed-2.0-Pro75.1 / 64.778.34.85.0
Doubao-Seed-2.0-Lite67.9 / 67.775.02.51.8
Qwen3.7-Plus75.1 / 73.277.716.611.5

W2 Summary. What diagnostic value do short, predominantly filter-based tasks under an offline protocol add to existing GUI benchmarks, and how far can their findings generalize to longer, multi-page workflows?

R: ConGUIBench complements existing GUI benchmarks by diagnosing goal satisfaction, procedural adherence, and state adaptation under matched conditions for the same constraint set. Its 118 tasks contain two to four constraints, predominantly filters (279/307), whose explicit states allow us to verify what has been completed and what remains; a constraint may require multiple primitive actions, so constraint count is not click count. The compact tasks and validated offline graphs support reproducible comparisons across instruction orders and execution states, separating intermediate progress from final completion. This provides a controlled diagnostic complement to end-to-end evaluation; our findings concern short multi-constraint workflows along validated paths and do not establish performance on long, open-ended web tasks.

BenchmarkEvaluation focus
Mind2WebGeneralization from web-action demonstrations
WebArenaEnd-to-end task completion in interactive websites
WebCanvasProgress through intermediate states and actions
DeepShopAspect-level and overall shopping-task completion
ConGUIBenchConstraint-level goal, order, and state diagnostics under matched conditions

W2/Q1 Summary. Are scrolling and typing supported, how are the three form-value constraints entered, and does “requires scrolling” indicate an agent error or an interface limitation?

R: Scrolling is supported, and the form-value constraints are annotated as click–type–confirm sequences. “Requires scrolling” refers to rejected clicks at states where no eligible click candidate exists and the correct action is to scroll, as indicated by an annotated scroll transition. Its 44.2%/51.8% EP/NPG figures represent shares of the Other error category. The form-value constraints enter price values: agents focus the relevant field, type the value, and confirm it. Their legacy annotations encode the numeric value in the action-type field.

W3 Summary: Does strict off-graph termination reject semantically valid alternative actions, and to what extent could this underestimate task success?

We control equivalent-action ambiguity while allowing multiple valid execution paths. We exclude tasks with multiple semantically valid actions for the same constraint, but retain different constraint-completion orders and annotated preparatory actions. Since instructions explicitly require filtering, searching or selecting items prematurely violates the specified workflow.

Off-graph actions terminate execution due to unvalidated successors, while CSR credits satisfied constraints. Error categories provide behavioral diagnostics, not exhaustive semantic validation. Thus, the protocol measures execution reliability within validated paths.

AuthorsOpenReview ↗

Response to Reviewer fgPk (Part 2)

W4 Summary: Does Q1 sensitivity arise from constraint mention order or accompanying wording changes, and does it persist when connective wording is controlled?

Order sensitivity persists after controlling for connective wording. We evaluate nine models on 40 NPG tasks, fully crossing two mention orders and three connective templates with three repeats (6,480 trajectories). Constraint phrases remain unchanged, isolating order and connective-template variations. Mean order-minus-paraphrase contrasts are positive for both outcomes, though model-level effects vary. This supports mention-order sensitivity beyond connective wording changes. The design and aggregate results are now reported in Appendix D.4, Table 15, of the revised manuscript.

Table Q5. Nine-model mean controlled disagreement contrasts (pp; 95% CIs). Each Δ subtracts same-text repeat disagreement; terminal-state disagreement is normalized Hamming distance. Intervals use 10,000 website-stratified physical-task bootstrap draws shared across models, with equal task/model weights and no multiplicity adjustment.

OutcomeΔorder (pp)Δparaphrase (pp)Δorder − Δparaphrase (pp)
Task success+3.26 [+1.88, +4.77]+0.22 [-0.44, +0.90]+3.05 [+1.66, +4.54]
Terminal constraint state+6.67 [+4.82, +8.65]+0.48 [-0.04, +1.02]+6.19 [+4.26, +8.28]

W5/Q2 Summary: Does mention order affect success mainly because some orders follow easier layout-dependent routes, and does excess disagreement remain when the executed route is held fixed?

Layout alignment does not consistently improve success, and instruction sensitivity persists within shared execution prefixes. We define layout order by control positions and low-cost routes by annotated scrolls, actions, and backtracking, without using model outcomes. All nine layout-match 95% CIs include zero; low-cost matching shows opposite nonzero effects for Qwen3-VL-8B (+8.19 pp) and GLM-4.6V-Flash (−5.48 pp) (Table Q6-A).

Conditioning on the same first one or two accepted transitions, excess cross-instruction success disagreement remains positive with 95% CIs excluding zero for 7/9 and 6/9 models, respectively (Table Q6-B). Thus, layout alignment alone does not consistently explain order sensitivity, which persists within shared initial paths. However, prefix conditioning does not control subsequent routes or selection effects.

Table Q6-A. NPG success-rate difference: matching order − other orders (pp; 95% CIs). Layout order is top-to-bottom, then left-to-right for vertically overlapping controls (68 tasks); the low-cost comparison includes only graph-feasible orders and tasks with both groups (86 tasks). Low cost is a predefined proxy, not a verified easiest route.

ModelLayout match (68 tasks)Low-cost order match (86 tasks)
Qwen3-VL-2B-0.23 [-9.00, +8.94]+0.23 [-6.87, +7.55]
Qwen3-VL-4B+4.93 [-3.07, +13.05]+1.92 [-4.34, +8.32]
Qwen3-VL-8B+5.08 [-4.85, +15.23]+8.19 [+0.39, +16.17]
Qwen3-VL-32B+4.02 [-2.72, +10.97]+2.44 [-2.99, +7.85]
GLM-4.6V-Flash-2.59 [-8.16, +2.41]-5.48 [-10.92, -0.55]
UI-Mate-9B-2.03 [-9.67, +5.19]-3.32 [-9.55, +2.17]
UI-Mate-27B-0.71 [-7.27, +5.16]-0.84 [-5.86, +3.81]
UI-Venus-1.5-2B-4.20 [-11.75, +3.47]+3.37 [-2.26, +8.91]
UI-Venus-1.5-8B-0.17 [-5.69, +5.28]-0.20 [-5.13, +4.72]

Table Q6-B. NPG excess success disagreement within shared execution prefixes (pp; 95% CIs). Δ subtracts same-instruction repeat disagreement from cross-instruction disagreement; coverage columns show eligible tasks and retained runs as a percentage of all runs for that model.

ModelΔ: same first transitionTasks; runs retainedΔ: same first two transitionsTasks; runs retained
Qwen3-VL-2B+11.10 [+6.25, +16.73]59; 34.4%+11.58 [+5.40, +18.64]29; 15.6%
Qwen3-VL-4B+7.50 [+2.69, +13.25]62; 37.8%+11.57 [+4.69, +19.79]36; 21.2%
Qwen3-VL-8B+11.89 [+7.29, +17.25]69; 58.2%+13.15 [+7.60, +19.05]40; 34.4%
Qwen3-VL-32B+1.17 [-0.12, +2.77]58; 38.9%+1.85 [+0.29, +3.78]38; 22.3%
GLM-4.6V-Flash+3.09 [+0.35, +6.62]75; 43.0%+4.64 [+0.65, +10.67]39; 23.1%
UI-Mate-9B+7.89 [+1.96, +14.56]57; 26.9%+1.66 [-0.71, +4.58]30; 13.0%
UI-Mate-27B+2.18 [-1.00, +5.65]48; 29.3%+3.20 [-0.47, +8.24]30; 13.7%
UI-Venus-1.5-2B+10.12 [+5.63, +15.38]65; 40.9%+9.58 [+3.57, +16.50]29; 16.6%
UI-Venus-1.5-8B+6.87 [+2.25, +12.05]75; 34.2%+4.30 [-0.40, +11.16]37; 11.7%
AuthorsOpenReview ↗

Response to Reviewer fgPk (Part 3)

W6 Summary: Which components—constraint decomposition, progress labels, auditor notes, or behavioral guidance—account for the checklist gains, and can incremental ablations isolate their contributions?

The component ablations show that the checklist benefit is not attributable to progress labels alone. We compare A: NoCL; B: the static constraint list; C: the same list with externally predicted DONE/TODO/UNSURE labels; and D: the full checklist, including notes and behavioral guidance. The static list helps under NPG, while dynamic status and the full checklist provide additional average gains across the evaluated models. These results support contributions from multiple components. Full per-model ablations appear in Appendix F.3, Tables 23 and 24, of the revised manuscript. Table 27 in Appendix F.5 (“Constraint Sources and Auditor Label Reliability”) further shows that replacing ground-truth constraints with auxiliary-parser-extracted constraints, while retaining the 4B auditor, changes the nine-model mean EP ISR from 50.0% to 49.0%. This suggests limited average sensitivity to constraint source in this setting, despite model-level variation.

Table Q7. Mean ISR changes (pp; 95% CIs where available). Component contrasts follow the shared paired evaluation protocol, average physical tasks and then models, and use 10,000 paired task-bootstrap draws. The Model-Parsed row is the separate EP greedy comparison reported in Appendix F.5, Table 27; its CI was not reported (—).

FormatComparisonΔISR [95% CI]
EPB − A: static list-0.9 [-2.1, +0.2]
EPC − B: dynamic status+2.6 [+1.8, +3.5]
EPD − C: notes + guidance+1.9 [+1.0, +2.9]
NPGB − A: static list+2.8 [+0.8, +5.0]
NPGC − B: dynamic status+4.4 [+3.3, +5.6]
NPGD − C: notes + guidance+1.9 [+0.8, +3.1]
EPModel-Parsed − Ground-Truth-1.0 [—]

W6. The agent is never asked to keep its own checklist. To show that agents cannot track their progress, the authors would need to prompt the agent to write and update its own checklist. If that works as well as the auditor's checklist, the agents can track state; they simply weren't asked to.

Self-checklist prompting yields lower mean ISR than the external status-only checklist. Both use the same status-only action-prompt format.

Self-checklist prompting has an average ISR deficit of 1.6 pp under EP and 2.3 pp under NPG, with heterogeneous model-level differences. The ISR-difference intervals include zero for Qwen3-VL-4B/8B/32B and UI-Venus-1.5-8B under both formats. These results support an average advantage for the external updater under this protocol, rather than an intrinsic inability of agents to maintain their own state.

Table Q8. Self-checklist − external status-only: paired differences (pp; 95% CIs). Δ = Self − External; positive values favor self-checklist. Mean External/Self ISR is 48.6%/47.0% under EP and 48.9%/46.6% under NPG. Confidence intervals use 10,000 paired physical-task bootstrap draws shared across models.

ModelEP ΔISR [95% CI]EP ΔCSR [95% CI]NPG ΔISR [95% CI]NPG ΔCSR [95% CI]
Qwen3-VL-2B-3.67 [-6.46, -0.95]-2.37 [-4.66, -0.09]-7.87 [-11.58, -4.68]-6.17 [-8.68, -3.92]
Qwen3-VL-4B+0.32 [-0.01, +0.76]+0.27 [+0.03, +0.65]+0.16 [-0.49, +0.89]+0.01 [-0.37, +0.38]
Qwen3-VL-8B-0.20 [-1.71, +0.93]-0.40 [-1.61, +0.54]+0.55 [-0.08, +1.39]+0.23 [-0.43, +0.93]
Qwen3-VL-32B+0.28 [-0.49, +1.00]+0.11 [-0.27, +0.45]+0.39 [-0.75, +1.34]-0.20 [-1.20, +0.49]
UI-Mate-9B-3.72 [-5.94, -1.53]-2.03 [-3.44, -0.60]-3.79 [-6.09, -1.63]-2.41 [-3.96, -0.91]
UI-Mate-27B-3.09 [-4.93, -1.43]-1.95 [-2.99, -1.01]-3.20 [-5.01, -1.55]-1.88 [-3.00, -0.84]
UI-Venus-1.5-2B-3.36 [-5.50, -1.32]-2.15 [-3.59, -0.75]-4.22 [-6.74, -1.91]-1.57 [-3.30, -0.01]
UI-Venus-1.5-8B-0.13 [-0.95, +0.44]-0.03 [-0.44, +0.30]-0.53 [-1.69, +0.48]-0.22 [-0.87, +0.37]
GLM-4.6V-Flash-0.84 [-1.53, -0.22]-0.59 [-1.15, -0.16]-1.84 [-3.21, -0.64]-0.78 [-1.51, -0.13]
Nine-model mean-1.60 [-2.28, -0.97]-1.02 [-1.46, -0.58]-2.26 [-2.97, -1.61]-1.44 [-1.85, -1.05]
Reviewer_eJgbOpenReview ↗
Rating
3(+1)
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper presents ConGUIBench, a benchmark for evaluating multi-constraint GUI agents along three dimensions: goal invariance, procedural controllability, and state adaptivity. The benchmark contains 118 tasks across four shopping and travel platforms, with 688 instruction-order variants in both non-procedural and explicit-procedure formats. Experiments on nine models show that constraint mention order affects execution outcomes, explicit procedures improve order adherence but provide limited gains in task completion, and agents struggle to recover from ineffective actions. An external checklist further improves task success rates by 3.7 and 9.2 percentage points under procedural and non-procedural instructions, respectively.

Critical strengths
  • Meaningful Evaluation Dimensions. The paper distinguishes goal invariance, procedural compliance, and state adaptivity, offering a more fine-grained understanding of GUI-agent reliability than terminal task success alone.
  • Controlled Experimental Design. The use of equivalent instruction variants, repeated executions, and annotated state transitions enables systematic analysis of instruction-order sensitivity. The checklist intervention also provides useful insights into the importance of tracking constraint satisfaction.
  • Informative Error Analysis. The paper categorizes failed actions into different error types, including grounding failures, repeated actions on completed constraints, and premature selections. This analysis helps explain why explicit procedural guidance improves execution organization without necessarily improving grounding accuracy.
Critical weaknesses

The benchmark has limited task diversity and complexity. All tasks contain only two to four constraints, and 90.9% of the constraints involve filtering operations. Consequently, the benchmark primarily evaluates short filtering workflows rather than general GUI-agent capabilities involving multi-page navigation or long-horizon interaction.

The evaluation protocol may be overly strict, particularly for smaller models. A single click outside the annotated valid transition regions immediately terminates the trajectory, without allowing the agent to correct its mistake. This may disproportionately penalize models with weaker grounding capabilities and conflate multi-constraint reasoning failures with coordinate-level localization errors.

Questions for authors

-Q1: The paper provides a breakdown of different error types, but the overall frequency of trajectories terminated by off-graph actions remains unclear. Could the authors report the number and percentage of such trajectories for each model? Additionally, would allowing agents to recover from one invalid click significantly change the results, particularly for smaller models?

-Q2: Could the authors evaluate one or two frontier multimodal models on a representative subset of ConGUIBench?

-Q3: Although COCR is consistently high, task completion remains substantially lower. Could the authors further investigate this gap by reporting the proportion of trajectories with identifiable full target sequences and analyzing the failure causes among trajectories that correctly follow the requested order? This would help distinguish conditional selection effects from grounding, state-tracking, and execution failures.

Minor Comments:

Section 4.1 is empty, and the Reproducibility Statement incorrectly references it. Appendix H is also described as providing error sample sizes, but these counts are not reported.

5 comments
AuthorsOpenReview ↗

Reponse to Reviewer eJgb

We thank the reviewer for the careful reading of our paper and the constructive feedback.

W1. The benchmark has ... long-horizon interaction.

ConGUIBench tests reliable multi-constraint execution in shopping and accommodation-filtering workflows. Holding requirements fixed while varying instruction order and execution state enables matched assessments of goal robustness, procedural adherence, and state adaptation. Table 1 summarizes this complementary focus; the full comparison appears in Sec. 2, manuscript Table 1.

Filtering provides verifiable constraint states, and two to four constraints keep order variants and alternative paths tractable to annotate and audit; individual constraints can still require multiple actions. Even in this setting, equivalent NPG variants yield 2.8–14.0 pp of excess success disagreement across nine open-weight models. This supports the diagnostic value of controlled multi-constraint evaluation within these workflows.

Table 1. Evaluation focus of representative benchmarks.

BenchmarkEvaluation focus
Mind2WebGeneralization from web-action demonstrations
WebArenaEnd-to-end task completion in interactive websites
WebCanvasProgress through intermediate states and actions
DeepShopAspect-level and overall shopping-task completion
ConGUIBenchConstraint-level goal, order, and state diagnostics under matched conditions

W2. The evaluation protocol ... coordinate-level localization errors.

Q1. The paper provides ... particularly for smaller models?

Strict termination measures execution reliability within the validated transition graph; the new experiment separately tests recovery from fixed erroneous states. Table 2a reports all action/output rejections that terminate execution, including non-click and unparseable outputs. This is broader than off-graph clicks alone.

Continuing after each agent's own mistake would require annotating different successor states. We instead test all nine models on the same 40 erroneous-state tasks across four websites, with 95 instructions per format and five repeats. Instructions specify final requirements; success requires correcting erroneous settings while preserving satisfied constraints along annotated recovery paths. Recovery ISR is 50.8%/50.9% under EP/NPG. These results quantify recovery within validated paths, but do not estimate the gain from permitting one invalid click in the original runs, including for smaller models. Full results appear in Sec. 4.2.4, Table 5, and Appendix E.3, Table 19.

Table 2a. Error-termination rates under the standard protocol (% of all runs).

ModelEPNPG
Qwen3-VL-2B85.84%82.18%
UI-Venus-1.5-2B59.42%63.72%
Qwen3-VL-4B52.24%62.41%
Qwen3-VL-8B48.72%57.35%
UI-Mate-9B58.87%60.73%
UI-Mate-27B51.98%54.16%
Qwen3-VL-32B50.38%56.69%
UI-Venus-1.5-8B40.87%47.30%
GLM-4.6V-Flash42.62%46.51%

Table 2b. Preliminary erroneous-state recovery ISR (%; 95% CIs). ISR averages repeats within instructions, instructions within tasks, then tasks and models equally; CIs use 10,000 physical-task bootstrap draws.

FormatRecovery success [95% CI]
EP50.8 [41.4, 60.3]
NPG50.9 [40.6, 61.2]

C1. Section 4.1 is empty ... are not reported.

We removed the empty Experimental Setup heading and corrected the Reproducibility Statement to cite Sec. 4.1.1 (overview), Appendix C.1 (model and inference settings), Appendix B (dataset construction), Appendix C (protocols and metrics), and Appendix G (prompts). The compiled references have been checked. We added per-model EP/NPG sample sizes to Appendix F.1: Table 21(a) uses all classified click errors, and Table 21(b) uses only Other-category errors. The caption clarifies both denominators and that the listed Other subtypes are not exhaustive.

Table 6. Sample sizes for the overall error classification and Other-subtype analysis. Counts refer to classified click errors only, not all error terminations reported in Question 2. Overall percentages use all classified click errors as the denominator, while subtype percentages are calculated only over errors classified as Other. The listed Other subtypes are not exhaustive.

ModelClassified click errors (EP / NPG)Other-category errors (EP / NPG)
Qwen3-VL-2B2908 / 27911608 / 1386
Qwen3-VL-4B1383 / 1559693 / 791
Qwen3-VL-8B1569 / 1622961 / 1014
Qwen3-VL-32B1419 / 1571584 / 684
GLM-4.6V-Flash832 / 822510 / 543
UI-Mate-9B1901 / 1943963 / 999
UI-Mate-27B1760 / 1775986 / 933
UI-Venus-1.5-2B2009 / 2126949 / 939
UI-Venus-1.5-8B1127 / 1306512 / 665
AuthorsOpenReview ↗

Reponse to Reviewer eJgb (Part 2)

Q2. Could the authors evaluate one or two frontier multimodal models on a representative subset of ConGUIBench?

Three additional API models show remaining order and state sensitivity on a prespecified 36-task subset. We evaluate 10 Amazon, 11 Booking, 9 JD, and 6 Xiecheng tasks, with 220 instructions per format and three runs each. Table 3a jointly reports completion, procedural adherence, and order sensitivity: Δstate intervals lie above zero for all three models, and Δorder intervals do so for Lite and Qwen. All paired EP−NPG ISR intervals include zero. Thus, the subset extends evidence of order sensitivity beyond the original nine models without establishing a consistent completion advantage for EP.

No-effect recovery varies by model, and Oracle labels do not consistently reduce the penalty. With one fixed replicate on the same subset, suppressing one valid action reduces Doubao ISR under both formats; Qwen intervals include zero. In a separate Oracle follow-up, five mitigation intervals include zero and Lite/EP is negative (Table 3b).

Table 3a. API completion, procedural adherence, and order sensitivity. Rates are percentages; contrasts are pp with 95% CIs.

ModelISR (NPG / EP)CSR (NPG / EP)EP COCR / SOCRNPG ΔorderNPG ΔstateISR: EP−NPG
Doubao-Seed-2.0-Pro64.7 / 75.176.4 / 80.678.3 / 72.44.8 [-0.5, 12.0]5.0 [1.2, 9.6]+10.4 [-0.8, 21.4]
Doubao-Seed-2.0-Lite67.7 / 67.977.3 / 73.675.0 / 65.72.5 [0.1, 5.4]1.8 [0.4, 3.4]+0.2 [-10.4, 10.5]
Qwen3.7-Plus73.2 / 75.184.9 / 79.077.7 / 72.816.6 [7.3, 27.8]11.5 [4.5, 20.5]+1.9 [-9.6, 12.6]

Table 3b. No-effect ISR changes and Oracle mitigation (pp; 95% CIs).

ModelFormatB−A ISR, all startsOracle mitigation
Doubao-Seed-2.0-ProEP−11.5 [−19.4, −4.7]5.6 [−8.3, 22.2]
Doubao-Seed-2.0-ProNPG−9.4 [−17.9, −1.9]−5.6 [−19.4, 8.3]
Doubao-Seed-2.0-LiteEP−19.0 [−28.7, −10.3]−13.9 [−30.6, −2.8]
Doubao-Seed-2.0-LiteNPG−20.9 [−32.1, −10.6]−11.1 [−36.1, 11.1]
Qwen3.7-PlusEP−2.9 [−7.6, 1.7]−8.3 [−27.8, 8.3]
Qwen3.7-PlusNPG−2.8 [−6.7, 1.2]5.6 [0.0, 13.9]

Q3. Although COCR is ... and execution failures.

Ordered progress does not guarantee terminal success. We measure the order in which constraints are completed during execution. Revised COCR counts runs whose nonempty completion sequence matches a prefix of the requested order, pooling all EP runs per model; zero-completion and wrong-order runs remain in the denominator. Coverage therefore rises from 14.19–59.85% to 100% (Table 4a). SOCR requires successful completion in the full requested order and uses task-macro aggregation, so the two rates should not be subtracted. Revised definitions and results appear in Appendix D.2 and manuscript Table 3.

Among runs with a correct completion prefix, 19.80–72.06% still fail, depending on the model. Table 4b classifies these failures by observed behavior.

Table 4a. EP order diagnostics (%). Revised denominator coverage is 100% for every model.

ModelOriginal denominator coverageCOCR (all runs)SOCR (task macro)
Qwen3-VL-2B14.19%39.33%17.65%
UI-Venus-1.5-2B40.93%60.61%38.41%
Qwen3-VL-4B48.52%60.84%42.12%
Qwen3-VL-8B52.15%60.17%44.58%
UI-Mate-9B41.66%59.33%42.24%
UI-Mate-27B48.37%59.97%46.31%
Qwen3-VL-32B50.70%58.43%47.02%
UI-Venus-1.5-8B59.85%72.24%61.52%
GLM-4.6V-Flash59.62%73.46%54.35%

Table 4b. Failure behaviors among EP runs with a correct completion prefix (%). Each row uses that model’s failed correct-prefix runs as the denominator; Total pools runs. Grounding covers near misses only. State-tracking-related behaviors include repeated-target and product/room-region clicks. Execution combines Other, rejected non-click actions, and unparseable outputs, and may also include larger grounding errors. Search/top-region clicks remain separate.

ModelGrounding (near misses)State-tracking-relatedExecution (incl. Other)Search bar/top region
Qwen3-VL-2B16.21%28.72%50.56%4.51%
UI-Venus-1.5-2B26.64%37.30%34.82%1.24%
Qwen3-VL-4B38.45%21.58%39.21%0.76%
Qwen3-VL-8B22.26%22.63%48.36%6.75%
UI-Mate-9B10.32%31.50%54.47%3.71%
UI-Mate-27B16.90%25.05%57.64%0.41%
Qwen3-VL-32B27.14%16.33%56.53%0.00%
UI-Venus-1.5-8B42.16%7.76%46.04%4.05%
GLM-4.6V-Flash6.03%10.78%73.13%10.06%
Total22.16%23.50%50.62%3.72%
AuthorsOpenReview ↗

Follow-up on Our Rebuttal and Revised Manuscript

Dear Reviewer eJgb,

Thank you again for your thoughtful feedback. We have addressed your concerns in our rebuttal and revised the manuscript with additional experiments and clarifications.

We would welcome the opportunity to discuss whether these updates address your concerns and which points, if any, need further clarification. If your schedule permits, we would greatly appreciate your thoughts and would be happy to provide additional explanations.

Thank you for your time and consideration.

Best regards, The Authors

Reviewer_3Va2OpenReview ↗
Rating
3(+1)
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper introduces ConGUIBench, comprising 118 shopping and travel tasks that separately evaluate GUI agents’ robustness to constraint reordering, procedural adherence, and state adaptation. Experiments across nine open-weight models reveal order-sensitive outcomes and brittle recovery despite strong conditional procedural adherence. An auditor-maintained checklist improves completion, suggesting constraint-state tracking is an important bottleneck.

Critical strengths

Controlled evaluation of distinct reliability properties. Matched instruction variants and state interventions separate goal invariance, procedural controllability, and state adaptation. This provides a more informative assessment than terminal success alone.

Useful evidence about constraint-state tracking. Repeated evaluations across nine models account for sampling variability, while oracle-state and checklist interventions provide converging evidence that maintaining satisfied and pending constraints can improve execution. This makes the analysis actionable for agent development.

Critical weaknesses

Any click outside an annotated transition terminates the episode, although the graph does not exhaustively cover valid interactions. Consequently, failure can reflect grounding errors, reasonable unannotated actions, or constraint reasoning failures. This is particularly consequential for the recovery claims: ordinary mistakes terminate execution, while recovery is tested only through a specially permitted no-effect intervention. Validation with continued interaction or a more permissive evaluator would help establish whether the findings generalize beyond the annotated paths.

Procedural controllability is defined through constraint-completion order, but evaluated through first-occurrence target-attempt order. Moreover, the reported 79.6–96.0% adherence is conditional on obtaining an identifiable full sequence, excluding incomplete trajectories. Although the paper acknowledges this distinction and reports joint success-and-order scores, the headline metric provides limited evidence of reliable procedural execution. Completion-order adherence and the proportion of trajectories excluded from the conditional metric should be reported together.

Questions for authors

Evaluation coverage: Among evaluator-rejected clicks, how often do agents select semantically valid actions outside the annotated graph, rather than incorrect targets? Does the existing error analysis distinguish these cases? This would clarify how much the reported failure rates reflect agent limitations versus annotation coverage.

Procedural adherence: What fraction of all executions contributes to COCR for each model? Using the recorded state transitions, how often does actual constraint-completion order match the requested procedure, compared with first-occurrence target-attempt order? These distinctions could materially change the interpretation of the high adherence rates.

Checklist evidence: Do you have controls that provide comparable additional inference computation without an explicit constraint checklist? Can you also provide paired confidence intervals for the checklist’s accuracy and stability gains? This would help assess whether the improvement specifically supports constraint-state tracking and how robust the reported gains are.

5 comments
AuthorsOpenReview ↗

Response to Reviewer 3Va2

We thank the reviewer for the careful reading of our paper and the constructive feedback.

W1. Any click outside ... or constraint reasoning failures.

Q1. Evaluation coverage ... versus annotation coverage.

R: Task curation excludes cases with alternative valid actions for the same constraint while retaining different completion orders across constraints. Instructions require applying the specified filters, so substituting search or selecting items prematurely departs from that workflow. Our error analysis distinguishes these behaviors and completed-target repetitions from grounding near misses (Sec. 4.3, Table 6). These are behavioral diagnostics of grounding and constraint-state awareness; Other remains a residual category.

W1. This is particularly consequential ... beyond the annotated paths.

R: The new experiment tests recovery from incorrect interface states, complementing the no-effect intervention. We evaluate nine open-weight models on 40 tasks across four websites, with 95 instructions per format and five repeats. Agents start from predefined erroneous screenshots and receive only the final requirements; success requires all constraints, including initially satisfied ones, to hold. These results extend recovery evidence to incorrect interface states within validated paths (Sec. 4.2.4, Table 5; Appendix E.3, Table 19).

Table R2. Preliminary erroneous-state recovery ISR (%; 95% CIs). ISR averages repeats within instructions, instructions within tasks, and then tasks and models equally; CIs use 10,000 physical-task bootstrap draws. Recovery follows annotated paths.

FormatRecovery ISR [95% CI]
EP50.8[41.4, 60.3]
NPG50.9[40.6, 61.2]

W2. Procedural controllability ... be reported together.

Q2. Procedural adherence: ... high adherence rates.

R: We measure the order in which constraints are completed during execution. This is what we mean by “first-occurrence target-attempt order.” A run counts toward the COCR numerator if its nonempty completion sequence matches a prefix of the requested order; completing all constraints is not required. The denominator retains all EP runs, including zero-completion and wrong-order runs, pooled per model. Revised coverage is 100%, with COCR of 39.33–73.46%. Table 2 also retains the original denominator coverage (14.19–59.85%) and full completion-order adherence for comparison; SOCR separately measures successful ordered completion using task-macro aggregation. The revised definitions and results appear in Appendix D.2 and manuscript Table 3.

Table 2. EP completion-order adherence and coverage (%).

ModelOriginal denominator coverageFull completion-order adherenceRevised COCRSOCR (task macro)
Qwen3-VL-2B14.19%79.19%39.33%17.65%
UI-Venus-1.5-2B40.93%88.23%60.61%38.41%
Qwen3-VL-4B48.52%89.21%60.84%42.12%
Qwen3-VL-8B52.15%89.38%60.17%44.58%
UI-Mate-9B41.66%95.06%59.33%42.24%
UI-Mate-27B48.37%96.03%59.97%46.31%
Qwen3-VL-32B50.70%95.48%58.43%47.02%
UI-Venus-1.5-8B59.85%93.02%72.24%61.52%
GLM-4.6V-Flash59.62%90.91%73.46%54.35%

Q3. Checklist evidence ... explicit constraint checklist?

R: CL yields higher mean ISR than free-form Reflection under matched auxiliary-model and token-budget settings. Both use Qwen3-VL-4B, the same input information and per-action schedule, greedy decoding, and a 512-new-token cap; NoCL has no auxiliary notes. Under the shared paired evaluation protocol, CL has the highest mean ISR under both formats (Table 3), supporting additional average benefit from organizing constraint states and evidence. Appendix F.4 reports the CL–Reflection contrast in Table 25 and the three-arm results in Table 26.

Table 3. Three-arm model-equal ISR (%; nine models).

ConditionEP ISRNPG ISR
NoCL46.941.7
Reflection48.747.3
CL50.550.8
AuthorsOpenReview ↗

Response to Reviewer 3Va2 (Part 2)

Q3. Can you also ... and stability gains?

Q3. This would help ... reported gains are.

R: Paired task-bootstrap intervals support positive model-average accuracy and stability gains under both EP and NPG (Table 4). Benefits vary by model: UI-Mate-9B/NPG improves accuracy but declines in stability. These results support average checklist assistance in the evaluated models; the Reflection control in Question 4 addresses the value beyond free-form auxiliary reasoning. Per-model intervals are in manuscript Table 7, with estimation details in Appendix F.2.

Table 4. Model-equal CL–NoCL gains across nine models (pp; 95% CIs). ΔISR = ISR_CL − ISR_NoCL; Gσ = σ_NoCL − σ_CL. σ is the within-instruction sample standard deviation of binary success, averaged over instructions and tasks. Marginal 95% CIs use 10,000 paired physical-task bootstrap draws, retaining within-task instructions and repeats and jointly resampling tasks across models; intervals are not multiplicity-adjusted.

FormatΔISR [95% CI]Gσ [95% CI]
EP+3.60 [2.08, 5.15]+1.11 [0.29, 1.93]
NPG+9.14 [6.36, 12.24]+1.97 [0.95, 2.99]
AuthorsOpenReview ↗

Follow-up on Our Rebuttal and Revised Manuscript

Dear Reviewer 3Va2,

Thank you again for your thoughtful feedback. We have addressed your concerns in our rebuttal and revised the manuscript with additional experiments and clarifications.

We would welcome the opportunity to discuss whether these updates address your concerns and which points, if any, need further clarification. If your schedule permits, we would greatly appreciate your thoughts and would be happy to provide additional explanations.

Thank you for your time and consideration.

Best regards, The Authors

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.