- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
DenseGen studies dense layout-to-image generation using fixed-resolution box canvases rather than one semantic token sequence per instance. Category-level masked attention supplies regional semantics, while spatial layering reduces ambiguity from overlapping boxes. Experiments on DIOR-R, DOTA-v1.0, and SODA-A, plus VisDrone, report better layout consistency and examine synthetic-data utility.
Critical strengths
-
The representation is simple and practical for dense layouts. Its advantage is supported by a meaningful fixed-canvas baseline: DOTA mAP improves from 45.33 to 56.05 over ControlNet (box), and SODA-A from 41.09 to 49.37 (Table 1). Thus, the evidence is not limited to comparisons against truncated instance-token methods.
-
Table 2 directly studies training-time truncation while holding the untruncated evaluation layouts fixed. Table 4 separately evaluates semantic conditioning and spatial layering. These controls make the main design argument more informative than a collection of benchmark wins.
Critical weaknesses
-
The downstream protocol compromises the interpretation of some results. Appendix A.4 uses DOTA validation layouts to generate detector-training images and evaluates on the same real validation split. Removing 10% of objects and flipping layouts does not eliminate evaluation-label information; the reported DOTA augmentation gain therefore is not a clean held-out result. The synthetic-only protocol also evaluates detectors on real images used to train the generator, so it cannot establish generalization of the full pipeline to unseen real images. This does not by itself invalidate the independent image-generation comparisons.
-
The main density comparison mixes representation quality with input capacity: instance methods are capped at 20 objects during training and 60 at inference, including evaluation on layouts above 80 objects. Figure 5 increases these limits for timing, but does not supply corresponding generation-quality results with matched complete conditioning. The practical resource advantage is convincing, while the stronger attribution to the representation itself needs this additional separation.
Questions for authors
-
Can DOTA augmentation be rerun using layouts from a partition disjoint from the final detector evaluation split?
-
Can you report generation quality for a representative instance baseline receiving all layout objects, alongside the resource-matched capped comparison?
-
For synthetic-only trainability, can evaluation use real images unseen by both the generator and detector?
We thank the reviewer for the careful scrutiny and positive feedback on our work, as well as for these constructive suggestions that substantially improve our evaluation protocol. Our responses to your questions are provided below.
W1P5 (Q1). We appreciate the reviewer's careful examination of our downstream evaluation protocol and identification of potential label leakage, which is crucial for a rigorous assessment of synthetic-data utility. Following this suggestion, we reran the DOTA-v1.0 downstream detection experiments using layouts disjoint from the final detector evaluation split.
Disjoint-layout construction. To avoid reusing DOTA validation annotations, we constructed a proxy layout pool exclusively from DIOR-R test annotations. We mapped corresponding categories to the DOTA taxonomy and separated vehicles into small and large categories based on oriented-box areas. After removing layouts without mapped objects, the pool contains 8,236 layouts and 113,899 oriented boxes across 11 DOTA categories. All compared generators use the same pool.
Protocol. The generators are unchanged (trained on the official DOTA training split), and each generates one image per proxy layout. ControlNet (shape), ControlNet (edge) and OF-Diff require structural conditions that boxes do not provide; these are extracted from the real DIOR-R images corresponding to the proxy layouts. DenseGen and the instance-centric methods use only boxes and category labels. All detectors are evaluated on real DOTA validation images over the 11 categories; these images and their annotations are never used for synthesis or detector training. Detector settings follow Appendix A.5.
The revised detection results (mAP50) are:
DenseGen achieves the best performance among the compared generators in both settings. Under Synthetic-only, it outperforms OF-Diff by 3.37 mAP50 points. Under Real + Synthetic, it improves the real-only baseline by 1.33 points and exceeds OF-Diff by 0.49 points. Compared with ControlNet (box), which uses the same base box-canvas representation, DenseGen gains 10.82 and 0.85 points in the two settings, respectively.
These results confirm that DenseGen's augmentation gains persist without reusing annotations from the final evaluation split. We thank the reviewer for prompting this more rigorous evaluation. We have provided 11-class mapping statistics, vehicle assignment criteria, and the proxy-pool construction procedure in Appendix A.5 and Table 5.