- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ViSculpt is a training-free multi-agent system for editing existing meshes through the Blender GUI. It combines planning and visual reflection with three mouse-trajectory primitives, Smear, Drag, and Draw, and a coarse-to-fine localization procedure. Evaluation includes 20 editing tasks, a blinded output-rating study with 48 participants, auxiliary VLM assessments, and qualitative comparisons with script-based agents.
Critical strengths
The paper addresses a useful problem: localized editing of existing meshes through natural-language instructions while preserving unrelated geometry. The combination of compact action primitives and deterministic trajectory generation is practical and well motivated.
The qualitative results demonstrate a promising range of deformation, smoothing, and surface-detail operations. The human evaluation provides useful initial evidence that the resulting edits are perceptually plausible.
Critical weaknesses
The evaluation needs stronger support for its comparative conclusions. The main study relies on independent 0–10 ratings, but the small mean difference between system and human results is not accompanied by uncertainty estimates for the difference or an analysis accounting for repeated ratings across participants and tasks. The auxiliary VLM evaluators also use noticeably different scoring scales. A supplementary blinded pairwise comparison between human-created and system outputs, with randomized presentation order, ties, and confidence intervals, would provide more direct evidence of relative quality. This could initially be added to the VLM evaluation without repeating the entire human study. The expertise, number, and time budgets of the human reference creators also need clarification.
The experiments establish output quality more clearly than system usability or the contribution of the agentic design. Participants rate completed outputs rather than use the system, so reduced interaction burden and accessibility to non-experts remain insufficiently evaluated. There is an overclaim about the system usability in Section 4, without any comparative study results.
The MCP comparisons and primitive/QuadLoc ablations are primarily qualitative, while the benefit of reflection is not quantitatively isolated. Furthermore, the MCP comparisons change both the backbone and interaction framework, making attribution difficult. Aggregate task success, retries, failure rates, and component ablations would substantially strengthen the evidence.
Questions for authors
Could you supplement the existing VLM ratings with blinded, order-swapped pairwise comparisons between system and human-created outputs, reporting win/tie/loss rates and uncertainty? How were the human reference creators selected, and what editing time budgets were provided?
Did participants interact with ViSculpt, or only evaluate its outputs? If only the latter, can the usability claims be narrowed, or supported by measurements of user effort, correction burden, and task completion?
Can you report aggregate quantitative results for the MCP comparisons and component ablations, particularly with and without reflection? Please clarify task counts, execution budgets, retry limits, and whether reported runtime and cost include failed attempts.
5 comments
4. Editing quality and efficiency with a lightweight backbone
Concern: The MCP comparisons change both the backbone model and the interaction framework, making it difficult to attribute differences to the agentic design.
Response: Figures 6-7 compare complete configurations and demonstrate a practical advantage in the model configuration needed to obtain competitive edits. In Figure 7, Codex + Blender MCP produces visibly degraded results with GPT-6 Astra at medium reasoning effort, while the max-effort configuration produces a competitive result. ViSculpt achieves visually comparable editing quality using the lightweight Gemini 3.5 Flash Lite backbone.
These observations support our argument that, for the demonstrated editing tasks, the proposed framework can reduce the reasoning burden placed on the underlying model. This is consistent with our design: the agents handle semantic decisions and compact parameters, while geometric procedures construct dense mouse trajectories.
This lightweight ViSculpt configuration also provides a substantial runtime and cost advantage in the reported comparison: approximately 1-2 minutes and USD 0.10 per edit, versus about 10 minutes and USD 4.00 for Codex with GPT-6 Astra at max reasoning effort. As clarified below, these measurements include failed attempts and retries.
Our claim is that the system can achieve competitive editing quality with a lightweight backbone and lower observed execution cost. These comparisons are conducted at the complete-system level; controlled comparisons using the same backbone could further isolate the framework's contribution. We will explicitly scope the conclusions to the tasks and configurations evaluated.
5. Primitive, QuadLoc, and reflection ablations
Concern: The primitive and QuadLoc ablations are qualitative, and the incremental benefit of reflection has not been quantitatively isolated.
Response: Figures 8 and 12 address two execution bottlenecks: selecting the intended mesh region and generating a suitable brush trajectory. Figure 8 compares direct coordinate prediction with QuadLoc's recursive quadrant selection; Figure 12 compares directly generated coordinate sequences with trajectories constructed from the primitives.
In the illustrated cases, off-target strokes produced no visible edit, whereas the full method produced the requested edits. We will include the existing before-and-after editing results alongside the localization/trajectory visualizations and explain these failure mechanisms. These cases support the motivation for the component designs.
The Reflection Agent compares pre- and post-edit observations against the sub-goal and provides feedback for parameter adjustment or another execution attempt (Section 3.2.3). We have not yet quantitatively isolated its incremental benefit, and we will add the corresponding experiments in future work. We emphasize that reflection is not a core contribution or source of novelty of this paper, and our arguments and conclusions do not depend on its ablation results.
6. Task counts, budgets, retries, and runtime/cost accounting
Concern: Please report aggregate success, retries, and failures, and clarify task counts, execution budgets, retry limits, and whether runtime and cost include failed attempts.
Response: The MCP comparisons cover the three tasks shown in the paper: the pumpkin and cat examples against the Claude-based baseline in Figure 6, and the armadillo example against Codex in Figure 7. Each tested configuration was repeated approximately five times.
ViSculpt allowed at most three execution attempts per subtask, including the initial attempt, i.e., up to two retries. The MCP baseline had no explicit retry cap. In our ViSculpt experiments, we generally observed completion on the first attempt, with occasional retries.
The runtime and cost figures cited above are averages over repeated experimental runs and include failed attempts and retries. They describe the practical performance of the tested configurations under their respective retry policies.
We will add these protocol details and clarify other execution-budget settings based on the original records.
Thank you for the detailed clarifications. The explanations of the evaluation protocol, human reference creation, and execution budgets address several of my questions.
However, my main concerns remain only partially resolved. In particular, the evaluation still lacks statistical analysis of paired differences, direct pairwise preferences, an interactive usability study, and quantitative ablations (especially for reflection). The MCP comparisons also remain limited and confounded by different backbones.
I appreciate the authors' willingness to clarify and narrow their claims, but stronger quantitative evidence would be needed to fully address my concerns.
Thank you for recognizing the value of localized mesh editing, the practical motivation for compact primitives, and the initial evidence of perceptual plausibility. We further clarify the existing study design and the scope of our conclusions below.
1. Blinded paired ratings, statistical uncertainty, and VLM scores
Concern: The mean-score difference lacks uncertainty estimates accounting for repeated ratings across participants and tasks. VLMs use different scoring scales. Blinded, order-swapped pairwise comparisons with win/tie/loss rates and confidence intervals would provide stronger evidence.
Response: Our study already used blinded, order-controlled paired ratings. For each of the 20 tasks, participants evaluated both the ViSculpt result and the human-created reference without knowing which method produced either result. The presentation order of the two methods' outputs was also varied. The 48 participants evaluated 40 results produced by the initial ViSculpt configuration and the human reference creators, assigning each result one overall 0-10 score considering instruction adherence, visual aesthetics, and geometric plausibility.
Thus, these observations are paired by both evaluator and task, although the questionnaire records a score for each output rather than separately asking participants to choose A, B, or a tie. We will describe the blinding, order control, and paired design more explicitly. Comparisons derived from paired scores differ from directly elicited preference votes.
The auxiliary VLM evaluation follows the same matched design: each VLM evaluated both methods on the same 20 tasks using the same questionnaire. An evaluator's overall tendency to award higher or lower scores does not by itself invalidate this comparison. An additive scoring offset cancels in the difference between the two methods' scores within that evaluator.
The human participants' mean ratings were 7.53 for ViSculpt and 7.20 for the references, providing evidence of competitive perceptual quality on this task set. The reported standard deviations describe score dispersion, rather than uncertainty in the mean difference.
2. Human reference creators and their editing protocol
Concern: How were the human reference creators selected, what was their expertise, how many were involved, and what time budgets were provided?
Response: The human reference edits were created by two PhD students in computer graphics with experience using Blender. No time limit was imposed on individual tasks. The 48 participants and the expert/non-expert groups in Table 1 describe the rating cohort.
We will add these reference-creation details to the manuscript. The comparison evaluates system outputs against these manually created references, rather than against a representative sample of professional artists under matched time budgets.
3. Natural-language interaction and the scope of usability claims
Concern: Did participants use ViSculpt or only rate its outputs? Claims about reduced interaction burden and accessibility to non-experts are not adequately supported without an interactive usability study.
Response: Participants evaluated completed outputs and did not interact with ViSculpt. The natural-language interface already provides a concrete simplification of interaction: given an input mesh in the configured environment, users describe the desired edit in natural language, and the system automatically plans and executes the Blender operations. Users do not need to manually carry out the corresponding Blender operations, write editing scripts, or draw brush trajectories. The pipeline and the demonstrated editing examples support this capability. We will clarify that "reduced manual interaction" refers to the automation of these low-level Blender operations.