Element-Conditioned Target Realization with Frozen GUI Agents

GUI execution couples two decisions that need not be learned by the same model: which element the instruction refers to and where to act on that element. We introduce an element-conditioned composition method that assigns target selection to an element selector while preserving the frozen receiver’s coordinate generation. Our element selector, FPIR, selects a candidate element and supplies its recorded text, role, and bounds as a hint. On 120 held-out states across four Android applications, FPIR element hints improve frozen receivers’ coordinate realization, raising native checker success from 90/120 to 98/120 for MAI-UI-8B, 78/120 to 98/120 for UI-Venus-1.5-8B, and 36/120 to 85/120 for AgentCPM-GUI-8B. A separate supervision audit shows that assigning conflicting action labels to a shared element score distorts the element-learning target. A same-state ablation finds that text and role without bounds retain most of the native execution gains, while the value of spatial bounds depends on the receiver.