- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a workflow for long-horizon animation generation. Given a text prompt, the system first generates 3D key poses, then interpolates between them to produce frame-by-frame motion, performs verification, and finally generates a Blender animation.
Critical strengths
-
The paper is logically well-structured, and the proposed workflow is clear and easy to follow.
-
The idea of first generating key poses and then interpolating between them is intuitive and straightforward, and the experimental results demonstrate its effectiveness.
Critical weaknesses
-
Conventional video generation models typically produce photorealistic and natural-looking results. In contrast, the Blender animations generated by DyCraft often appear cartoonish and lack visual realism, as many objects are constructed from basic geometric primitives.
-
How does DyCraft determine the appropriate 3D key poses for different types of motion? Are these key poses generated directly by an LLM-based agent?
-
Based on my understanding, DyCraft mainly integrates existing agents and tools, and it has a new workflow that first generates 3D key poses and then interpolates between them to produce continuous motion. However, even this workflow appears to be easily achievable through prompt engineering: instead of instructing the LLM to generate the entire animation directly, the prompt is modified to encourage key-pose generation followed by interpolation using some heuristics. Although the results are good, I find the algorithmic and framework-level novelty rather limited. The proposed approach seems more like a carefully designed prompting strategy than a fundamentally new method or framework.
-
The ablation studies are limited to qualitative comparisons, without quantitative results to demonstrate the contribution of each component. Quantitative ablations would be necessary to better understand the effectiveness of the proposed workflow and individual modules.
-
The evaluation is conducted on only 16 text prompts, which I consider insufficient to demonstrate the robustness and generalizability of the proposed method.
-
I believe the comparison between DyCraft and the bare-agent baseline is not entirely fair. DyCraft has access to various additional tools, such as the CAD authoring interface and humanoid motion skills, which are not equally provided to the bare agent. A more convincing comparison would equip the bare agent with exactly the same tools but without explicitly instructing it to generate key poses before producing continuous motion. Instead, the agent should be allowed to explore how to use these tools independently. This would help distinguish whether the improvements primarily come from the proposed workflow or from the additional tools. Moreover, I believe that current frontier LLMs, such as GPT-6-Astra, are already capable of reasoning about how to effectively use these tools when provided with appropriate instructions.
-
The authors should also report and compare the API costs and wall-clock generation times of different methods. Since DyCraft introduces additional planning, verification, and refinement steps, it is important to understand the computational overhead associated with the proposed workflow.
Questions for authors
Please see the "Critical Weaknesses" section
2 comments
4. (W4) Quantitative Ablations
We also ran an add-one ablation on an independently chosen set of 8 random briefs. Three independent arms each add prompt rewriting, the verifiers, or 3D storyboarding to the same bare GPT-6-Astra agent, with the model, effort, and time budget fixed across the arms of each brief. The 3D storyboarding arm also includes prompt rewriting and the verifiers, which it depends on. Raters compared each arm's film with the bare agent's film for the same brief.
| Arm | Preferred over bare agent ↑ | Penetration ↓ |
|---|---|---|
| Bare agent | — | 72.1% |
| Prompt rewriting | 67% (20 of 30) | 67.5% |
| Verifiers | 62% (16 of 26) | 34.3% |
| 3D storyboarding | 58% (23 of 40) | 24.0% |
Raters preferred each arm over the bare agent. The verifiers lower penetration from 72.1% to 34.3%, and the 3D storyboarding arm reaches 24.0%. We plan to extend this ablation to more briefs for the final version.
5. (W5) Benchmark Size
The 16 prompts of the submission already span diverse scenarios and three categories of embodiments. They cover humanoid robots, humans/animals (e.g. a barista, dog, and macaque), and physical mechanisms (e.g. a marble run or boat drawbridge). Each prompt is a complete multi-shot film, while the 4D generation methods we cite evaluate single-shot clips of at most a few hundred frames. The 16 films contain 201 shots and 440 planned key states, with 232 characters and objects in motion. We prioritized coverage across task categories and depth per sequence over raw task count.
In direct response to this concern, we expanded the benchmark to 24 briefs (33.9 minutes of animation in total), balancing the three embodiment categories at 8 briefs each. We show the final DyCraft film for each: https://dycraft-anonymous.github.io/#gallery
In a new user study on all 24 briefs, 109 raters on Prolific compared films in randomly ordered pairs and answered three questions per pair. The table gives the share of judgments preferring DyCraft. Raters preferred DyCraft over VIGA on 23 of the 24 briefs and over the bare agent on 20.
| Question | DyCraft vs. VIGA | DyCraft vs. Bare agent |
|---|---|---|
| Overall 4D realism | 92.0% | 75.6% |
| Physical plausibility | 88.5% | 70.1% |
| Motion quality | 88.5% | 71.0% |
| Pooled over the three questions | 89.7% | 72.3% |
| Metric | DyCraft | Bare agent | VIGA |
|---|---|---|---|
| Penetration ↓ | 13.0% | 80.1% | 74.9% |
| Floating ↓ | 2.7% | 15.7% | 26.1% |
6. (W6) A Bare Agent with the Same Tools
We ran the tool-matched baseline you describe. T gives the bare agent every DyCraft tool, with the same reference documentation for each tool that Full DyCraft's agent receives, and leaves the agent free to explore and use them. T ran with W and Full DyCraft on the same 8 briefs and settings as in Section 3.
| Bare agent | All tools, optional (T) | Full DyCraft | |
|---|---|---|---|
| Preferred by raters ↑ | — | 44% | 56% |
| Penetration ↓ | 55.8% | 59.3% | 1.1% |
Raters preferred Full DyCraft in 24 of 43 judgments. With all tools available, T stays at 59.3% penetration, no better than the bare agent's 55.8% and far from Full DyCraft's 1.1%, which is lower on 7 of 8 briefs.
7. (W7) API Cost and Wall-Clock Time
All methods use GPT-6-Astra. We count the tokens of every agent role and price them at standard API rates ($10, $1, and $50 per million uncached input, cached input, and output tokens). Active time includes the turns of the main agent and leaves out idle gaps. The table gives medians over the 24 briefs.
| Measure | DyCraft | Bare agent | VIGA |
|---|---|---|---|
| Active time per film (h) | 6.8 | 1.0 | 3.3 |
| Cost per film ($) | 216 | 19 | 53 |
The bare agent is not cut off by a time limit. It declares completion on its own, often without planning, inspecting, or verifying its work. DyCraft spends its additional time on these steps, which yield better scenes and fewer geometric violations. In a median DyCraft run, the harness's own jobs take 51.8% of the active time, led by rendering at 12.6%, verification at 10.5%, CAD building at 7.4%, and storyboarding at 6.7%. The rest is the agent's own turns, in which it reasons over renders and check results and writes the scene and motion code.
Dear Reviewer hwf9,
Thank you for the detailed review and constructive feedback. Because of its length, our response spans two comments.
1. (W1) Visual Realism
DyCraft does not just produce video animations. It writes an entire editable Blender project, and its films are renders of that Blender project through the authored cameras. This enables far more downstream applications compared to generated videos alone, including the ability to easily re-pose the scene and render from arbitrary viewpoints. Besides, the animated assets could also be imported into simulators or game engines, the generated kinematic motions could be retargeted onto real robot embodiments, and the Blender assets directly provide synthetic data such as depth, segmentation, and 3D trajectories. As the paper argues, video generative models produce realistic footage, but they are very difficult to control precisely and often contain geometric, temporal, and physical inconsistencies in their outputs.
Our anonymous results page now provides an interactive 4D viewer for all delivered scenes, enabling real-time free-viewpoint control directly in your browser: https://dycraft-anonymous.github.io/#viewer.
2. (W2) How Key Poses Are Chosen
Yes, the agent automatically chooses key poses for each brief without human intervention. In our motion prompt rewriter (Appendix A.1), a transition between key poses is defined as a change in what holds, supports, or moves a body: for example when a robot regrasps a tray, sets a load down partway, or shifts its stance. The same rule covers characters, robots, and mechanisms.
As stated in our method section, the agent first authors each key pose in Blender, renders it, then revises it from the renders and verifier feedback. Before the agent can write the motion between two states, both of those states must pass their verifiers and the agent must inspect their renders (Sec. 3.3).
3. (W3) Prompt Engineering
We directly test this alternative. A fresh-context LLM translated our paper into a detailed workflow prompt (W), which we gave to the bare agent without our tools. We ran the bare agent, W, and Full DyCraft on 8 random briefs with GPT-6-Astra at medium effort, the same code, and an 8-hour budget, and asked raters to compare the W and Full DyCraft films for each brief. Every film is at https://dycraft-anonymous.github.io/#ablations
Raters preferred Full DyCraft in 23 of 35 judgments. The workflow prompt leaves penetration at 20.7%, far from Full DyCraft's 1.1%, which is lower on 6 of 8 briefs.
A prompt can describe key poses and checks, but the agent must then build the checks itself. Without our verifiers, the W agent wrote its own collision checks. On 5 of the 8 briefs, it reported that every frame passed them, yet those films still had 4.4% to 72.0% penetration when scored with our final evaluator.
DyCraft instead supplies verifiers that check every key state and every frame of motion.