- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes MICA, a framework for studying how interface representations affect language agents under matched executable capabilities. MICA constructs MCP and CLI interfaces from a shared semantic action contract and uses a shared runtime to isolate the effect of interface design. Experiments across six models and three environments show that interface representations influence task performance, interaction cost, semantic decisions, and failure patterns. The paper further introduces DART, a repair mechanism that separates semantic action selection from interface realization and improves recovery from realization failures.
Critical strengths
- Capability-matched interface construction
MICA generates both interfaces from a shared semantic action contract and uses a shared validation and execution pipeline, reducing capability and execution-related confounds in the comparison.
- Complementary local and trajectory-level analysis
Matched-state factorial probes separate presentation, realization, and feedback effects, while paired trajectories characterize subsequent divergence. Together, they provide a more detailed understanding of how interface differences affect agent behavior beyond endpoint performance.
Critical weaknesses
- Limited generalization beyond controlled interface representations
MICA studies MCP-style and CLI-style interfaces under carefully controlled matched semantic contracts and shared execution pipelines. While this design enables clean attribution of interface effects, it remains unclear whether the observed behaviors transfer to real-world MCP servers, terminal environments, and production agent scaffolds with additional tooling and orchestration layers.
- Limited attribution of DART’s improvements
DART combines several components, including semantic commitment formation, phase-specific prompting, and interface-specific realization repair. Since the evaluation compares DART against the Base policy without isolating these components, it remains unclear whether the gains primarily come from commitment preservation, additional reasoning steps, or other intervention effects.
Questions for authors
- Regarding generalization beyond controlled interfaces
Could the authors clarify how they expect the findings from MICA’s controlled MCP/CLI comparison to transfer to deployed agent systems with native MCP servers, terminal environments, and additional orchestration layers? (See Weakness 1.)
- Regarding the source of DART’s improvements
Could the authors provide additional ablations or analysis to isolate the contribution of semantic commitment preservation from other components in DART, such as additional reasoning steps or realization repair? (See Weakness 2.)
- Can the observed interface effects be linked to identifiable task or interface characteristics?
While the paper analyzes action selection, failure pathways, and component interactions, it remains unclear whether these analyses reveal general patterns that predict when MCP-style or CLI-style representations are likely to be more effective.