- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies how space syntax can be used to improve the spatial organization of floorplans generated by generative models. The authors propose SSIO, an analysis pipeline that converts heterogeneous floorplan representations into convex-space access graphs and computes spatial integration scores. Based on real residential floorplan datasets, they construct the RPLAN-SSI benchmark, using IPD and PIA to compare generated floorplans with real residential plans in terms of functional integration profiles and the integration advantage of public spaces. They further use integration-based rewards for PPO post-training and evaluate the approach on five diffusion-based floorplan generation models.
Critical strengths
The paper abstracts the theoretical account of spatial accessibility in space syntax, a theory from architectural design, into a unified convex-space access-graph representation and further uses this representation for diffusion-model post-training, offering cross-disciplinary insight. Building on this architectural design principle, the authors propose a set of quantitative metrics that transform the qualitative description of spatial organization in architectural theory into quantifiable statistics and training feedback, with potential cross-disciplinary applications.
Critical weaknesses
I have reservations about interpreting the reported metric improvements as evidence of design improvement. The core issue is that the paper uses the spatial organization property defined by the SSIO access graph and its integration scores both to construct the training reward and to define the main evaluation metrics, IPD and PIA. Although the training reward, IPD, and PIA are not identical formulas, they are all based on integration scores derived from the SSIO access graph. The training reward optimizes the integration difference between living rooms and nonliving rooms, PIA measures the difference between living rooms and other room categories, and IPD compares functional domain distributions aggregated from these scores. Therefore, the current experiments primarily demonstrate improvement in a proxy metric based on integration, rather than independently demonstrating improved architectural design quality or design capability. Comparisons on the same conditions and experiments using different centrality definitions strengthen the internal robustness of the metric improvements, but they do not resolve the issue of external validity for this proxy metric.
The paper’s construction of access graphs across different output formats, the benchmark and the policy bindings designed for each generator are clear methodological contributions. However, the paper does not provide evaluations by architects, data on user behavior, circulation simulations, or other independent measures of architectural performance. Its discussion of applying the method to other design fields also remains primarily conceptual. The paper therefore needs to explain why the difference in integration statistics between generated and real floorplans constitutes a design problem worth addressing, and what practical design benefits these methods provide beyond improving IPD and PIA. Independent validation of design quality, or an analysis of the relationship between changes in integration and actual usage outcomes, would help support the paper’s stronger conclusions.
Questions for authors
Please try to address my questions and concerns in the Critical weakness section.
6 comments
W1 & W2 (1/2): Evidence independent of SSIO scores
We agree that metrics derived from the same SSIO graphs as the reward cannot by themselves establish design quality, and that internal robustness checks do not resolve external validity. This comment gives the evidence that does not use SSIO scores; the next explains why the integration gap is a design problem and how we scope our claims.
1. Blind assessments by design-trained assessors
We asked assessors with design training rather than lay users. A real-estate designer and an architecture student, neither involved in the project, independently compared the same 50 condition-matched Base/SSPT pairs. Model identities and scores were hidden; the question was which layout better supported everyday residential use. The sample was stratified across test blocks and PIA changes. Both independent assessors preferred SSPT and higher-PIA layouts in most definite choices. Architecture researchers also conducted a separate author-involved discussion review (§5.4, Table 5, p. 9; Appendix D.2.1, Table 27 and Figure 14, pp. 43–45):
| Assessment | Prefer SSPT | Prefer higher PIA | Base has higher PIA when Base is preferred |
|---|---|---|---|
| Real-estate designer · independent blind | 83% (34/41) | 73% (30/41) | 43% (3/7) |
| Architecture student · independent blind | 67% (28/42) | 67% (28/42) | 43% (6/14) |
| Architecture researchers · author-involved discussion | 74% (29/39) | 72% (28/39) | 40% (4/10) |
The first two percentages use definite preferences as their denominator; the last uses Base-preferred cases. These are three assessments of the same 50 pairs. A designer described one SSPT layout as placing the kitchen and bathroom more appropriately relative to bedrooms, enabled by the living-space configuration. Thus, the judgments connect the measured changes to broader use considerations. The recorded examples and procedure are documented in Appendix D.2.1 (pp. 43–44).
2. Native metrics computed without SSIO
HouseDiffusion's own metrics, which do not use SSIO, are reported with their costs on the independent final test (Table 2; acceptance in §5.2):
| Metric (final test) | Base HD | +SSPT | Meaning |
|---|---|---|---|
| Compatibility ↓ | 2.537 | 2.572 | missing or extra access relations vs. the requested graph |
| FID ↓ | 7.798 | 9.087 | visual distance of renderings to real plans |
| Exact-8 acceptance ↑ | 94.5% | 96.5% | measurable outputs that keep all eight spaces |
- Human judgments where conformity worsens. Among the 50 blind-assessed pairs, Compatibility increases for 22. In this subset the real-estate designer still preferred SSPT in 15 of 18 definite choices and the architecture student in 12 of 17 (Appendix D.2.2, Table 28).
- What these layouts look like. In three examined pairs, the Compatibility increase comes from a one-unit gap between a door and a required room, which the native overlap rule reads as a missing link; this explains a specific count change rather than judging architectural acceptability (Figure 15). Three pairs with higher Compatibility that both independent assessors preferred illustrate functional arrangement, overall layout, and a local overlap change (Figure 16).
W1 & W2 (2/2): Why the integration gap is a design problem, and the scope of our claims
1. Residential evidence
Across four residential corpora spanning 15 countries, public spaces have the highest integration (Figure 3, p. 4). HouseDiffusion preserves this ordering, but its Public margin is 46.3% weaker (Figure 4, p. 5). In 12.1% of Base outputs another room, often a bathroom or kitchen, is more integrated than Living, against 1.0% of real homes and 1.9% after SSPT (derived from Table 22, p. 41). In such layouts a bathroom or kitchen, rather than the shared living space, is the most accessible space of the home, as in case B of Figure 7 (p. 8), where SSPT replaces bathroom dominance with Living anchoring under the same eight-room program.
2. Theoretical grounding
The public-space lead also has a theoretical basis. Space syntax theory holds that everyday living belongs in integrated space, where the movement a layout generates is natural to that function, and treats departures from this pattern as possible failures of design (Hillier, 1996, p. 304). The everyday shared space holds the home together: the other functional zones depend on it for their integration, and removing it reduces the layout to a single sequence of rooms (Hillier, 1996, pp. 254, 261). Residential studies likewise report living-room-centered configurations and the private and public aspects of living-room experience (Byun & Choi, 2016; Rechavi, 2009). PIA quantifies this lead per plan (Appendix B.3).
3. What the metrics target
The benchmark compares distributions rather than rewarding a higher PIA, and its two measures divide the work. IPD checks whether the typical integration profile of the four functional domains matches real homes. PIAD, the Wasserstein-1 distance between a generator's per-plan PIA distribution and that of real RPLAN homes, checks plan by plan whether the shared living space leads as it does in real homes: it is 0 only when the distributions coincide and grows when the lead is too weak or too strong (Eq. (2), Appendix B.3). A higher PIA is therefore not itself the target.
4. What the internal evidence shows, and the scope of our claims
Matched conditions, connected-only comparisons, and alternative centralities test internal robustness: gains persist on the 3,914 conditions whose graphs are connected both before and after post-training (Appendix D.1.2, p. 42) and under all four centrality definitions (Table 25, p. 42). As you note, they share SSIO's source. The 200-pair case analysis shows what changes in the layouts: among 144 PIA-increasing pairs, 131 keep the same number of recovered room-level links or fewer, so the gains mainly reflect reorganized access rather than added links (Appendix D.1.5, Table 26, p. 43). We do not claim effects on inhabitants' behavior: the human judgments are expert assessments of layouts rather than observations of use, and the conclusion states that understanding users' intentions and simulated user feedback remain beyond this scope (§7, p. 10). Our claim is accordingly that SSPT moves the spatial organization of generated layouts closer to real residences, and that independent assessors mostly prefer the resulting layouts.
Response to Reviewer TnoW: summary
We thank you for the thoughtful review and the recognition of SSIO, the benchmark and the policy bindings. This comment summarizes our responses; the follow-up comments give the details and evidence.
W1 & W2: Do integration-metric gains indicate design improvement, and why is the gap worth addressing?
W2 (cross-domain part): The discussion is mainly conceptual
Follow-up comments, in order: W1 & W2 (1/2) and (2/2), then the cross-domain part of W2. Q1 refers to the weaknesses and is covered by them.