- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes CityExpander for generating large-scale city layouts from text. The main idea is to first use an LLM to turn the text description into zoning and land-use constraints, and then generate the layout in two stages: a global stage for the overall structure and a local stage for details. The authors also introduce SC-GSD to reduce inconsistencies between overlapping local regions. The experiments are conducted on data derived from OSM, and the results show that CityExpander generally performs better than the compared methods in terms of layout quality, controllability, and generation efficiency.
Critical strengths
- The paper clearly identifies the key challenges in large-scale city layout generation: maintaining global coherence, preserving local geometric detail, and enabling precise spatial control from text. The motivation is convincing and well connected to the limitations of existing sliding-window and direct text-conditioning approaches. Based on it, CityExpander combines a compiler-grounded planning agent, a global–local diffusion pipeline, and semantic-consensus synchronized denoising in a natural way. The intermediate zoning-ratio representation is sensible, as it provides a practical bridge between high-level language instructions and low-level spatial generation.
- The experiments cover single-tile quality, text-guided generation, large-area synthesis, computational efficiency, and several component ablations, demonstrating its capability.
Critical weaknesses
The evaluation of text–layout alignment could be more direct. Table 2 measures similarity between generated and reference layouts using CLIP features and category-ratio errors, but neither metric explicitly evaluates whether the generated layout follows the input description. A text–image similarity metric would therefore be a useful addition. Additionally, the paper highlights directional control—for example, placing an urban area in the east—as an advantage over direct text conditioning, yet the evidence for this claim is mainly qualitative. A small targeted evaluation covering directional and regional constraints would make the controllability claim substantially more convincing.
Questions for authors
- Please See Critical Weaknesses.
- The global stage is directly constrained by the zoning-ratio field, while the local stage appears to depend mainly on the coarse structural latent. It is unclear whether this latent alone is sufficient to preserve the intended regional composition throughout local refinement. Some additional analysis or ablation on this point would be useful.
- It would also be useful to report the end-to-end inference time of CityExpander and the baselines, including the time required by the Condition Plan Agent. Furthermore, a comparison with MajutsuCity (CVPR26) would strengthen the evaluation, as it addresses a closely related language-driven text-to-layout setting.
- Section 3.1 assigns an intended function s_k to each region, and the planner is described as organizing functional zones with explicit land-use compositions. As I understand it, only the compiled class-ratio field is passed to the diffusion model. This means that, for example, residential and commercial regions with the same geometry and class ratios would result in identical conditioning, despite having different functional labels. Since these labels may be useful for practical personalization, the authors could consider incorporating them more directly into the generation process to better preserve the functional distinctions specified by the user.
2 comments
Response to Reviewer d4oy (Part 2/2)
Q3. End-to-End Generation Cost. We measured end-to-end time on the same 25 prompts using one RTX 4090. Times include planning, sampling, decoding, and saving, but exclude model loading and warmup.
| Method | Planning time (s) | Total time (s) |
|---|---|---|
| CityCraft-Text | - | 4.95 |
| CityExpander | 96.52 | 114.14 |
We report end-to-end time only for single-patch generation because CityCraft-Text only supports text-conditioned generation of a fixed-size patch. Extending it to larger scenes would also require spatial planning to coordinate multiple patches. Our agent planning and sampling together take longer than the baseline. This extra time is expected because planning involves several remote LLM calls to generate and revise the plan. This extra cost supports a more capable generation pipeline. Our experiments show better layout quality with ratio conditioning and stronger instruction-level semantic control with agent-planned conditions. The agent also separates the text description from the output scale, allowing the same description to guide large-scale scene generation. In contrast, the text-condition variation of CityCraft baseline maps each description to a fixed-size patch. The comparison with MajutsuCity requires retraining the baseline, and the experiments have not been done due to limited computational resources. We will share the results if the experiments are completed.
Q4. Semantic label degradation. We agree with the reviewer that incorporating functional labels more directly into generation could better support personalization. Our original motivation for introducing semantic labels was to provide an intermediate planning step inspired by chain-of-thought reasoning. These labels guide and constrain the assignment of class ratios, rather than asking the agent to directly predict numerical ratios for all five semantic classes.
With the current backbone unchanged, one possible approach is to assign finer-grained functions downstream. The original region labels and user instructions can be retained as metadata and provided alongside the generated layout to an LLM-based planner. CityCraft demonstrates this separation: an LLM assigns building functions and architectural attributes after layout generation, followed by asset retrieval and 3D scene construction.
Another approach is to incorporate functional labels directly by expanding the land-use categories generated by the backbone, allowing it to output finer-grained semantic classes such as residential and commercial areas. We will explore these directions in future work.
Response to Reviewer d4oy (Part 1/2)
We thank the reviewer for the careful reading and constructive feedback.
Direct evaluation against the input text. We thank the reviewer for suggesting a direct evaluation against the input text and quantitative evidence of directional and regional control. We used GPT-6-astra to derive 4,353 programmatic unit tests and 4,908 open-ended semantic tests from the 1k-text prompts. The programmatic tests automatically check measurable constraints on the generated semantic layouts, including class presence, regional density comparisons, and regional concentration, with rules and thresholds fixed before scoring. The open-ended tests use VLM-assisted visual assessment to evaluate requirements involving shapes, spatial relations, topology, and qualitative attributes. A requirement passes when a reasonable interpretation is supported by visible evidence. GPT-6-Astra is used as judge. We report constraint satisfcation rate (CSR) here.
The pass rates for selected evaluations of directional and regional control are reported below:
The results show that CityExpander achieves better instruction-level semantic alignment than CityCraft-Text with both Gemini and Qwen. The benchmark already includes subsets for regional and directional instructions, where CityExpander also outperforms CityCraft-Text by a large margin. These results further support CityExpander’s stronger text–layout alignment.
CLIP-T (CLIP text-image similarity) slightly favors CityCraft-Text despite its lower constraint satisfaction rates. We interpret this discrepancy as a failure of CLIP-T to reflect the spatial compliance improvements measured here. A plausible explanation is that global image–text similarity emphasizes shared semantic content without sufficiently distinguishing spatial arrangements: a layout may contain the requested semantic classes while placing them in incorrect regions or failing to satisfy their relative-density requirements. Consequently, CLIP-T alone is insufficient to evaluate instruction-level spatial control in this setting.
We thank the reviewer for highlighting the need to measure composition changes during local refinement. We compared the Global and Final outputs against the same compiled zoning-ratio field, aggregating each layout onto the condition grid and measuring mean absolute error over the vegetation, building, road, and water channels. On the 25 regular prompt families across four scales, the SC-GSD results are:
The mean error increases by 0.000157 in ratio units. This analysis shows limited additional deviation from the conditioning field during Local refinement on the evaluated cases.