- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies canonical shortcutting in artist-grounded text-to-image generation: conditioning on an artist name often causes a model to insert high-frequency motifs, palettes, or material treatments that are unsupported by the requested scene, instead of reliably performing a context-sensitive stylistic transformation. The paper introduces SACP, which represents underspecified artistic intent as an explicit control state z = (s, q, h, r, b), and Atelier, a closed-loop system combining an artist knowledge base, scene-role-bound local patches, backend-aware planning, a global critic, and a local AUTHCRITIC. ArtIntentBench evaluates Van Gogh and Qi Baishi across re-rendering, period control, historically unseen subjects, shortcut auditing, and human preference. The results show lower shortcut substitution rates and improvements in style proximity, structural preservation, and human preference. My main reservations are that the component-level methodological novelty is limited, scaling to new artists requires substantial artist-specific resources, and some evaluation axes share the same artistic ontology used to build the system.
Critical strengths
- The paper identifies a real failure mode. Outputs often substitute frequent artist associations for context-sensitive style. Formalizing this behavior as canonical shortcutting and quantifying it with a frozen taxonomy and majority-vote annotation is a clear and valuable contribution.
- Atelier integrates intent parsing, knowledge retrieval, local evidence binding, backend-aware planning, two critics, and reflective memory into a complete loop. The schema, prompts, thresholds, stopping rules, and ablations are documented, making the system auditable and the paper-level reproducibility details strong.
Critical weaknesses
- Limited component-level novelty. Atelier mainly combines LLM planning, retrieval, backend routing, critic-guided refinement, and memory, all common in agentic workflows. Its novelty lies more in the artist-grounded control representation and system integration; the paper should distinguish systems contribution from scientific novelty.
- A gap remains between an artist-agnostic schema and artist-specific instantiations. The experiments cover only Van Gogh and Qi Baishi, and each instantiation requires artist priors, curated summaries, an annotated patch bank, a dedicated AUTHCRITIC/rubric, and a frozen taxonomy. Qi Baishi demonstrates retargeting, but not low-cost or scalable generalization.
- Some evaluation axes are coupled to the system's artistic ontology. The retrieval resources, critic rubric, anti-shortcut constraints, taxonomy, and parts of the state audit share related artist-specific dimensions. Generic metrics and human evaluations mitigate this concern, but gains under independently constructed taxonomies, reference sets, or rubrics remain untested.
Questions for authors
- What is the core scientific contribution of SACP beyond an engineering schema? If the explicit factorization z = (s, q, h, r, b) is a testable inductive bias, what property or prediction can it provide that an unstructured planner with the same information and compute cannot?
- How can shortcuts be distinguished in principle from legitimate uses of canonical motifs? Could the authors give a taxonomy-independent counterfactual criterion? With the artist fixed and scene or period compatibility varied, a legitimate motif should track context, whereas a shortcut should remain driven mainly by the artist name. This would handle the contextual ambiguity of starry skies or inscriptions.
- Can the control dimensions be learned rather than manually specified? Could preserve/transform decisions, style regimes, retrieval targets, and anti-shortcut factors be learned from edit trajectories, expert critiques, or preferences while remaining interpretable? If they must be hand-specified, how can the cost of constructing s, q, h, r, b and the associated resources be controlled at scale?
3 comments
Thank you for the clarifications. I still view the contribution as primarily engineering-focused, with limited methodological novelty, though it may offer useful insights for future research on artist-specific style generation. I will keep my score there but would be fine with rejection. I would also welcome the other reviewers’ perspectives.
Thank you for the follow-up. Our methodological claim concerns how a request and artist references are translated into a generation plan.
1. What SACP adds to planning. An artist’s painting contains both stylistic properties and particular subjects. Using it as a reference requires deciding which properties to transfer and which parts of the requested scene to preserve. SACP represents these decisions explicitly and assigns retrieved evidence to specific scene roles.
For a library scene, for example, a reference may guide the palette and brushwork of a surface, while the furniture and spatial layout remain preservation targets. The reference therefore has a defined role in the plan: it supports a particular change to the requested scene.
2. How these decisions guide generation and revision. The generation plan and the critic use the same preservation requirements and reference bindings. Critic feedback identifies violations and repair targets; the next round updates the plan and evidence bindings while retaining the original request. SACP connects what should change, the evidence supporting that change, and the feedback used to revise it. This is the planning procedure whose contribution we aim to establish.
3. Evidence from the ablation. With the generator pool, sampling settings, and three-round limit held fixed across three seeds, removing the structured-intent pathway increases SSR from 32.50% to 55.83% and W₂ from 82.11 to 85.23. This supports the usefulness of the proposed planning decisions within Atelier.
Q1: Response to concerns about the scientific contribution of SACP
Thank you for this insightful question.
1. Core scientific contribution
SACP formulates artist-grounded generation as semantically constrained style adaptation. SACP separates the content that must be preserved from the stylistic changes allowed by the request, and grounds those changes in artist evidence. The state z=(s,q,h,r,b) provides a shared control representation for retrieval, planning, generation, evaluation, and revision.
The inductive bias is to preserve request-specific meaning while allowing evidence-supported stylistic variation. Preservation decisions and reference bindings guide what should appear, where stylistic changes should occur, and how those changes should be evaluated. Negative prompts help enforce these constraints.
2. Testable prediction and supporting evidence
Under matched information and computational resources, explicitly maintaining these decisions across stages should reduce context-unsupported substitutions relative to unstructured planning, while retaining the requested stylistic changes. This prediction concerns whether artist-associated content priors override the request when both planners have access to the same evidence.
Table 9 evaluates the structured-intent pathway as a whole. Removing this pathway increases SSR from 32.50% to 55.83%, with the generator pool held fixed. These results support the contribution of explicit intent modeling to canonical-shortcut reduction.
Q2: Response to concerns about legitimate motifs and shortcuts
Thank you for this insightful question.
Criterion. A canonical motif is legitimate when it fits the requested scene, period, and content. To examine this distinction, we can hold the artist and core subject fixed while changing whether the request supports or conflicts with that motif. Its use should respond to this change. Repeated insertion despite conflicting requirements, particularly when it replaces requested content, provides evidence of shortcutting. This criterion applies to any motif, including those outside our frozen taxonomy.
Examples. As stated in §1, a swirling sky is appropriate for a Van Gogh Saint-Rémy nocturne and is not inherently a shortcut. In an indoor close-up explicitly excluding any sky, inserting that motif would violate the request. Likewise, Qi Baishi inscriptions should be retained when requested and omitted when the user explicitly asks for a painting without text.
Supporting evidence. Our period-control experiment keeps the scene fixed across four requested periods for the same 57 requests, with W₂ measured against period-specific reference works. Atelier achieves the lowest W₂ in all four periods under both configurations. These results support responsiveness to historical context; the counterfactual criterion above specifies how to assess the appropriateness of individual motifs.
The objective is to preserve legitimate artistic expression while preventing familiar artist associations from overriding the request.
Q3: Response to concerns about learning control dimensions and scaling
Thank you for this insightful question.
What is specified, and what can be learned? The five control fields are shared across artists. The Perceiver and Planner infer and revise their values from the request, available evidence, and feedback, within predefined artist-specific rules. Individual requests therefore do not require manually written control states.
Learning from trajectories and preferences. The explicit representation provides concrete targets for supervision: expert feedback can correct a preservation decision, a style-regime hypothesis, an evidence binding, or an inappropriate constraint. Our recorded plans, failure tags, and repair targets could be combined with expert corrections or preference labels to train these decisions. Keeping the decisions and their evidence bindings explicit would allow the learned outputs to remain inspectable. This is a future training direction; the current system uses feedback during inference.
Controlling adaptation costs. New artists reuse the schema, workflow, annotation pipeline, and training recipes. VLM annotation and Grounded-SAM automate local evidence construction, while AuthCritic labels follow sample provenance. For Monet and Gauguin, annotation uses 14.03M/12.50M tokens, and synthetic-data generation plus adapter training requires 23.44/17.59 A800 GPU-hours, respectively. Artwork selection and validation of artist-specific knowledge and evaluation rules remain necessary.
The same control fields can be reused across artists and serve as targets for future supervised learning.