- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces a Spatial Canvas Interface that combines semantic, identity, text, and pixel bindings with element-level and global text specifications. The authors construct Compo-200K through automatic poster generation and annotation, and train the proposed model Compo. They evaluate the model on a 500-sample benchmark. Experiments show that Compo achieves stronger compositional controllability than both general-purpose image generation models and dedicated poster generation systems while maintaining high visual quality.
Critical strengths
(1) Poster generation involves various distinct types of constraints that should not be conflated. Specifically, preserving the identity of a subject while altering their pose is a fundamentally different requirement from maintaining the shape and position of specific visual elements. Representing these requirements on a unified canvas, while establishing clear links to textual specifications, offers a logically coherent approach with practical utility. Furthermore, this representation can serve as an intermediate construct within an automated planning process.
Critical weaknesses
(1)Compo receives extensive training on the input format (i.e., spatial canvas and text specifications), while the general image editing baselines do not. Several baseline outputs even reproduce the canvas labels. Without a comparison using the same backbone and training data but a different conditioning format, the results show the value of the complete system more clearly than the claimed advantage of composing over prompting.
(2)The benchmark is too close to the training pipeline to establish performance on independently composed inputs. Appendix A.2 uses the same generation process with different seeds, and the references and layouts are derived from rendered target posters. This leaves performance on unrelated user assets and new layouts largely untested.
Questions for authors
(1) What instructions and input conversions were used for the strongest baselines? In particular, how were canvas labels distinguished from text that should appear in the output? This would help determine how much of the reported gap comes from input interpretation.
(2) Does the test split discard identities, styles, or themes, or only generated samples? Are there existing quantitative results on independently assembled canvases with external references? Such evidence would directly affect the assessment of generalization.
4 comments
Q1: Input format conversion when testing baselines
1. General text-and-image-to-image models. For general image editing models, we provide additional instruction interpretation:
task_description = (
"Generate a poster according to the input image "
"and the following text prompt. The input image specifies the "
"layout and reference, while the text prompt defines their detailed generation requirements.\n"
"Text labels on the input image only serve as "
"identifiers linking regions to textual descriptions. "
"Unlabeled assets must preserve original shapes and appearances, allowing only lighting adjustments.\n"
"Remove all auxiliary bounding boxes "
"and text labels from the final image."
)
alongside the Spatial Canvas and text specifications to explicitly explain our task and the semantics of different binding types. In particular, these instructions clarify the distinction between canvas labels, which serve as identifiers for associating visual regions with textual specifications, and actual text content that should appear in the generated poster. This additional guidance is intended to help pretrained models correctly interpret our Spatial Canvas without task-specific training.
2. Dedicated poster generation models. For dedicated poster generation methods, we implement deterministic, code-based input conversions that transform our structured annotations into the model-specific conditioning formats, preserving the original constraint information to the extent supported by each model's interface. Importantly, these methods do not directly receive our rendered Spatial Canvas. Instead, they receive the converted annotations in their native input formats. Therefore, the potential confusion between canvas labels and actual poster text does not arise for these dedicated models. Finally, we adapt the inputs of different baselines to their respective interfaces while preserving the intended control constraints as much as possible.
Q2: Separation between the training data and the benchmark, and the effectiveness of existing quantitative results on independently assembled canvas with external references
Our benchmark split is not performed merely at the level of generated poster samples; instead, we deliberately introduce differences at the source data construction stage to reduce overlap between training and evaluation.
1. Difference between training and benchmark data. As described in Section 3.1 (Poster Creation, Page 4) and Appendix A.1 (Text Asset Collection, Page 16), target posters are constructed from predefined text asset repositories, including content and style repositories. Importantly, the repositories used for training and evaluation only have a limited overlap, with additional object categories and styles in the benchmark that are absent from the training repositories. Furthermore, we employ different random seeds for benchmark construction and introduce different object count distributions. Variations in object categories, object counts, and random sampling naturally produce different spatial arrangements and layout combinations. Together, these measures help reduce distributional overlap, ensuring that our benchmark is not simply constructed by regenerating training samples with different random seeds.
2. Generalization to novel references and layouts. According to the difference mentioned above, our benchmark includes newly constructed Spatial Canvas with reference assets and layout combinations that differ from those encountered during training. Therefore, the quantitative results in Table 1 already provide evidence of Compo's generalization to new content, styles, and automatically assembled layouts, rather than merely measuring performance on previously seen poster configurations.
Furthermore, Appendix Figures 8-9 (Page 22-23) present qualitative examples using external visual assets outside our training data, demonstrating Compo's ability to handle unseen references in real-world poster design.
W2: Independence and difference between the benchmark and the training data
We would like to clarify that we intentionally adopt the same construction pipeline for the training and benchmark sets to ensure a consistent input format between training and inference. Specifically, both sets employ the same Spatial Canvas structure, incorporating Pixel Binding, Text Binding, Semantic Binding, and Identity Binding. However, sharing the same construction pipeline does not imply that the two sets contain overlapping data. They differ in three important aspects:
1. Data composition: Each training sample consists of a paired Spatial Canvas and its corresponding poster image, whereas each benchmark sample contains only a Spatial Canvas, from which the model is required to generate a poster image independently.
2. Spatial Canvas content: As described in Appendix Section A.2 (Pages 16-17), although both sets share the same Spatial Canvas structure, the actual content of their components differs. Specifically, the benchmark set uses different semantic categories for Semantic Binding, different text content and numbers of text boxes for Text Binding, and different reference images for Pixel Binding. Since these elements jointly determine the layout and visual content of the generated posters, such differences lead to distinct poster layouts and content, thereby avoiding content overlap between the training and benchmark sets.
3. Poster styles: Beyond differences in layout and content, the benchmark set also includes poster styles that are absent from the training set, further evaluating the model's ability to generalize to unseen visual styles.
Therefore, the shared construction pipeline ensures consistent input representations between training and inference, while the differences in data composition, Spatial Canvas content, and poster styles enable a fair and comprehensive evaluation of the model's generalization capabilities on unseen data.
Dear Reviewer yWde,
Thank you again for your valuable time, constructive feedback, and positive rating. With only one day remaining in the discussion period, we would like to kindly follow up on our responses.
Following your suggestions, we have further clarified the advantages and effectiveness of the composition nature of our proposed Spatial Canvas representation, and conducted additional comparisons using the same backbone and training data but different conditioning formats. We have also clarified the separation between the training data and evaluation benchmark, and discussed the existing quantitative and qualitative evidence of generalization to novel layouts and external references.
We would greatly appreciate any further feedback or comments you may have on our responses.
Best regards,
Authors
At first, we sincerely thank you for your valuable time, constructive comments, and positive rating.
W1: Advantages of composing and effectiveness of the Spatial Canvas representation
1. Advantages of composing over prompting. We introduce a controllable poster generation task that jointly supports four constraints: (1) Semantic Binding associates textual concepts with regions; (2) Identity Binding preserves reference identities while following detailed instructions; (3) Text Binding specifies exact text and locations; and (4) Pixel Binding preserves designated visual content. Existing general-purpose text-and-image-to-image models primarily rely on textual instructions, which, even when detailed, may struggle to accurately incorporate diverse visual references and maintain consistency. Meanwhile, dedicated poster generation methods typically employ task-specific conditioning formats that cannot simultaneously support all four binding types. In contrast, our Spatial Canvas Interface unifies heterogeneous control conditions into a single, compositional representation, eliminating the need for separate conditioning mechanisms.
2. Compatibility with general image editing models that are without training. Modern pretrained image editing models commonly use VLMs as visual-semantic encoders and possess strong visual understanding and instruction-following capabilities from large-scale pretraining. Our Spatial Canvas, combined with detailed text specifications and explicit interpretation instructions, naturally aligns with their standard text-and-image-to-image (TI2I) interface.
3. Effectiveness of the Spatial Canvas representation. To further isolate the benefit of our representation from task-specific training, we additionally evaluate ChatGPT Images 2.6 on 50 benchmark cases under two input settings: Detailed Prompt (text-only) and Spatial Canvas + Text Specifications. We also include Compo-LongCat for comparison. The human evaluation results (Elo / Win Rate) are shown below:
With the same pretrained model and without task-specific training, introducing the Spatial Canvas substantially improves instruction following (Elo: 928.7 → 1020.4; Win Rate: 37.0% → 55.5%), indicating better adherence to reference and layout constraints. These results provide evidence that our Spatial Canvas representation offers benefits beyond detailed text-only prompting.
4. Comparison using the same backbone and training data but a different conditioning format. To further isolate the benefit of our Spatial Canvas representation, we reimplement CreatiDesign's conditioning format on the LongCat-Image backbone and train it on the same Compo-200K dataset. However, CreatiDesign's conditioning format does not natively support constraints such as our Identity and Semantic Bindings. Therefore, as in our baseline evaluation, we convert the original Compo-200K inputs into CreatiDesign-compatible formats while preserving as much constraint information as possible. Due to time and computational constraints, we cannot reimplement and retrain every heterogeneous conditioning format on LongCat-Image. We therefore select CreatiDesign as a representative case study to examine the impact of different conditioning formats under the same backbone and training dataset.
The results are shown below:
Under the same backbone and training dataset, Compo-LongCat substantially outperforms CreatiDesign-LongCat (0.752 vs. 0.550 Avg. Score), particularly on Identity and Semantic Binding metrics. These results further highlight the limitations of task-specific conditioning formats when extending to new types of constraints, and support the flexibility of our unified Spatial Canvas representation.