- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Relational Abstractions for Diffusion Models (RDM), a framework for improving spatial reasoning in conditional image generation. The method first learns object-centric representations using a slot-based autoencoder trained with a reconstruction objective, then learns relational abstractions over these representations. The resulting relational features guide diffusion-based generation, with the goal of helping generative models capture the structural relationships and logical constraints underlying a task. The authors evaluate RDM on several reasoning tasks, including Akari, Coldoku, Tangram, and LogicFace, and compare it against standard diffusion baselines and Spatial Reasoning with Denoising Models (SRM). They also provide ablations examining the contribution of relational abstractions and experiments on additional benchmarks, including MNIST-Sudoku and Counting Polygons.
Critical strengths
- Promising approach to incorporating structure into generative reasoning: The paper addresses an important limitation of generative models: they may learn visual patterns without explicitly capturing the underlying relations and constraints that define a valid solution. Combining object-centric representations with relational abstractions is a compelling approach to this problem.
- Evaluation across diverse reasoning tasks: The experiments span grid-based puzzles, geometric compositions, and facial attributes, providing evidence across different forms of structured generation. The inclusion of additional benchmarks and ablations helps assess the applicability of the proposed approach.
Critical weaknesses
- Insufficient clarity regarding the SRM comparison and its task-specific configurations: The comparison with SRM is potentially informative, but the implementation and configuration of the baseline are not sufficiently clear across the different tasks. In particular, it is unclear how the patch-based formulation and uncertainty-guided sequential sampling are adapted to tasks such as LogicFace, where the variables are semantic facial attributes rather than grid cells. More details would make the comparison easier to interpret.
- Motivation for the reconstruction objective: The Discoverer is trained using an image reconstruction objective, which encourages the slots to collectively encode the information needed to reconstruct the input, but does not explicitly encourage object-level decomposition or semantic disentanglement. The supplementary results show that some slots remain inactive or capture multiple Tangram pieces, while some facial attributes are not cleanly disentangled in LogicFace. This raises the question of why reconstruction alone is an appropriate objective for learning representations intended for relational reasoning, and whether the authors could better motivate this design choice.
Minor suggestion for extending the related work:
- The LogicFace setting is related to prior work on representing and controlling disentangled facial semantics . For example, Nested Attention: Semantic-aware Attention Values for Concept Personalization, Omni-ID: Holistic Identity Representation Designed for Generative Tasks, and Latent-Identity Tuning in Text-to-Image Personalization Models investigate disentangled semantic representations of personalized subjects using learned queries.
Questions for authors
I would be open to raising my recommendation to a Clear Accept if the authors' responses adequately address the following questions:
- SRM configuration: Could the authors clarify the exact SRM configuration used for each benchmark? In particular, how are patches defined, and how is uncertainty-based sequential sampling implemented for non-grid tasks such as LogicFace?
- Motivation for the Discoverer objective: Why is image reconstruction alone sufficient for learning representations suitable for relational reasoning, given that it does not explicitly enforce object-level correspondence or semantic disentanglement? Could the authors better motivate this choice?
4 comments
Dear Reviewer Kobh,
Thank you again for taking the time to review our work.
We have provided detailed responses to your comments and questions, and revised our manuscript with additional experiments and clarifications. We would appreciate your feedback on our rebuttal, as the discussion period is approaching the end.
We would also be happy to address any remaining concerns about our submission.
Best regards, Authors
Response to authors
I thank the authors for their response which resolved my concerns. I will raise my score.
We thank Reviewer Kobh once again for their time and thoughtful suggestions.
We are pleased to hear that all concerns are now fully addressed, and also thank the reviewer for supporting the acceptance of our submission.
Best regards, Authors
Response to Reviewer Kobh
We thank the reviewer for pointing out this ambiguity. We now added a new subsection with details on "Implementation of SRM'' under Sec. B.4.
We follow the official SRM implementation. In SRM, uncertainty is learned per square patches during training, and we use the predicted-order sampling without overlap (their best setting on MNIST Sudoku), which denoises the lowest-uncertainty patch first. In LogicFace, indeed SRM has no notion of semantic attributes as its variables are always spatial patches, so attributes can span several patches. This mismatch, which is also present in Tangram and Tildoku, explains why SRM's sequential sampling only helps on aligned grids (MNIST-Sudoku, Coldoku). This is an inherent limitation of SRM for generalized reasoning settings, since it is restricted to grid-aligned reasoning problems.
Our implementations were adapted to align with SRM's inductive bias, by matching the patch size to the grid dimensions in Akari (patch size fixed to 18) and Coldoku (patch size fixed to 20). For unstructured puzzles (Tangram and LogicFace), we set the patch size to 8, which was proposed for real-world images by [Wewer et al., 2025] in Counting Polygons. Alternative values did not yield any improvements.
Object-centric representation learning methods, such as Slot Attention [Locatello et al., 2020], are designed to learn disentangled object representations through image reconstruction objectives. By design of the training algorithm, the iterative refinement loop in the bottleneck forces slots to compete for distinct regions in images, resulting in object disentanglement (see Figure 13). Our motivation to use this approach is two-fold. First, we argue that generalized spatial reasoning requires abstraction of object semantics rather than generating a plausible solution from raw pixels. Second, this abstraction should be task-agnostic and independent of puzzle labels. Representations learned via Slot Attention satisfies both, since its reconstruction objective requires no object masks or labels, and it does not impose a fixed spatial (grid) structure.
We agree that slot decomposition is not always perfect, but previous work has shown that disentanglement does not need to be perfect to help downstream tasks (e.g., OCRA [Webb et al., 2023] for RPM puzzles). Our results also support this, where learned relational abstractions improve reasoning performance across all datasets. Since slots are high-dimensional continuous representations, their encoded information is relatively robust against noise, and the Abstractor can still exploit and interpret the disentangled space to learn patterns and relations that effectively guide the diffusion model for reasoning.
We thank the reviewer for these references. We now mention them in context of our work under Sec. A.4, with the details of LogicFace.