- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work propose reference-based graphic design generation with a continuous creativity control parameter. For the given inputs (e.g., reference design, a textual design intention, etc), the devised method generate a layered design while exhibiting a controllable degree of creativity. In particular, authors fine-tunes VLM with a regression head on 6k designs with human creativity ratings. This scoring model is used to rank large scale dataset and labeled dataset is used to train the generator. The evaluation includes distributional design metrics, text alignment, an Multimodal LLM evaluator, and a study with 10 professional graphic designers. The method obtains reasonable quantitative and qualitative results. Although the evidence for the central claim of meaningful, generalizable creativity control is substantially weaker than the evidence for producing appealing design variations.
Critical strengths
(1) The problem is useful and challenging.
- Helping designers explore variations around a reference could be valuable in practical design workflows. Balancing novelty, communication goals, and reference relevance is a difficult problem, and an effective AI tool for this purpose would have clear potential benefits.
Critical weaknesses
(1) The creativity scorer lacks sufficient validation, and the necessity of fine-tuning is not established.
-
The entire pipeline depends on a scalar creativity score learned from human ratings, but Section 3.1 does not explain who supplied the 6,000 designs' labels, how many designers participated, how many ratings each design received, what rubric they followed, or how disagreements were aggregated. The 10 professional designers are explicitly described for the later user study. It is unclear whether they also supplied the scoring labels. Without this information, it is difficult to assess whether the scorer captures broadly meaningful design creativity or the preferences of a particular annotator group.
-
The reported MAE of 0.50 on 600 held-out designs is not compared with a prompted pretrained VLM, a frozen VLM with a trained regression head, or a simple score-prediction baseline. A strong pretrained VLM might already predict these labels reasonably well, but the paper does not test this. Consequently, the results do not establish either the need to fine-tune the VLM or the benefit of the additional training. Human rating variability is also needed to interpret the MAE.
-
The reported model-human consistency of 0.71 is similarly difficult to interpret without scorer baselines, human-human agreement for this specific task, sample counts, and a precise definition of consistency. Moreover, the triplets are drawn from widely separated score strata, making this a relatively coarse ordering test. Success on these triplets does not establish reliable distinctions between nearby creativity levels, which are important for continuous control.
(2) The paper does not adequately distinguish creativity from visual complexity, style, or attractiveness.
-
The paper treats creativity as a scalar attribute but does not provide a sufficiently explicit operational definition or annotation rubric. For graphic design, originality must be considered together with the communication goal and the appropriateness of the solution. A minimalist poster can be highly creative, while a visually elaborate poster can be conventional or ineffective.
-
Figure 2 raises the concern that colorful, abstract, or visually elaborate designs may receive higher scores. Some variations in Figure 3 also change illustration style and color. These examples do not prove that the score model relies on such shortcuts, and the figure also includes restrained designs. However, the paper provides no controlled analysis that rules out this explanation. For example, it could compare designs with matched content and layout while varying saturation or ornamentation, and evaluate creative minimalist designs against visually complex but conventional ones.
-
There is also a conceptual gap between an absolute score difference, s(Y) - s(X), and creativity relative to a reference. Two existing designs with different absolute ratings need not form a meaningful creative transformation. Retrieving a target using visual embedding similarity does not itself establish that the target preserves the reference's brief or represents an original reinterpretation of it.
(3) Required disclosure and citation presentation need correction.
-
I could not find an AI use statement in the supplied manuscript. ICLR 2027 requires a dedicated AI use disclosure section. The authors should add the required statement describing relevant AI use in the research and manuscript preparation.
-
Minor: The citations are also difficult to read. Many appear as unparenthesized author-year strings embedded in the prose, especially in long citation lists and statements such as “Qwen3-VL-30B Bai et al. (2025).” Parenthetical citations (e.g., "\citep") where appropriate would improve readability.
Questions for authors
(1) Who provided the creativity ratings for the 6,000 Awwwards designs? Please report the number and backgrounds of annotators, ratings per design, annotation rubric, aggregation procedure, and inter-rater agreement. Were these annotators independent of the later evaluation participants?
(2) How is creativity distinguished from visual complexity, saturation, ornamentation, stylistic change, and aesthetic quality? What evidence shows that the score model handles creative minimalist designs and reference-relative originality appropriately?
(3) What permissions, licenses, or other basis support the collection and use of Awwwards and Freepik designs, including model training, publication of examples, and any proposed redistribution? Please also clarify provenance and usage rights for retrieved image and SVG assets.
(4) Was the need for IRB or equivalent ethics review assessed for both annotation and the designer study? Please report approval, exemption, or the applicable determination that review was not required, together with consent, compensation, and participant-data handling procedures.