- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the limitations of discrete annotations for aesthetic image cropping. It proposes a Continuous Preference Field (CPF), which combines peak clustering, off-lattice refinement, structured negatives, and field assembly to construct a reward over crop coordinates. CPF is used to train a vision-language cropping model, CPIC, through supervised fine-tuning followed by GRPO. The same refinement procedure produces recalibrated benchmark annotations, termed CPICD. Validation includes comparisons on GAIC, FLMS, FCDB, and CPICD, component ablations, qualitative examples, and two human preference studies.
Critical strengths
-
A thoughtful, task-specific reward design. CPF explicitly incorporates multiple acceptable compositions, tolerance to local coordinate changes, and penalties for undesirable boundary changes. Combining these properties provides a plausible alternative to optimizing geometric overlap alone. The ability to reuse existing annotations makes this a practically relevant direction, and the reward construction is the paper’s strongest technical contribution.
-
Broad experimental coverage. The paper evaluates several families of cropping methods and provides substantial ablations of supervision strategies, field components, and refinement scores. The human studies additionally examine both predicted crops and recalibrated annotations. This breadth helps assess individual design choices and provides useful empirical support beyond selected qualitative examples.
Critical weaknesses
-
Insufficient novelty positioning and incomplete comparisons. GAIC [1] already discusses non-unique crops, local redundancy, and the limitations of IoU. Prior work also addresses diverse compositions [2] and annotation bias causing quasi-trivial predictions [3]. These established observations are insufficiently distinguished from CPF’s specific contribution. Several relevant methods [2–6] are omitted, weakening the novelty and state-of-the-art claims.
-
The incremental benefit of the complete reward design is not sufficiently established. Results are mixed: CPIC improves FCDB IoU but trails Venus on FLMS IoU. In Table 6, refined targets with an IoU reward already match full CPF’s output-box count and FLMS LAION score; CPF adds only 0.007/0.013 IoU on FLMS/FCDB. Without repeated-run statistics, the reliability of these additional gains remains unclear. The evidence therefore falls short of the strong claims about CPF’s necessity and consistently superior generalization.
-
The evaluation protocol and evidence for resolving template collapse are inadequate. Appendix A describes predicting one box per image, whereas standard GAIC SRCC requires scores over multiple candidate crops. The conversion to candidate rankings and the treatment of off-grid predictions for ACC₁₀ are unspecified. Furthermore, counting distinct boxes across different images measures coordinate repetition rather than meaningful compositional diversity. These issues limit both reproducibility and the interpretation of the reported improvements.
[1] Hui Zeng, Lida Li, Zisheng Cao, and Lei Zhang. Reliable and Efficient Image Cropping: A Grid Anchor Based Approach. CVPR, 2019.
[2] Gengyun Jia, Huaibo Huang, Chaoyou Fu, and Ran He. Rethinking Image Cropping: Exploring Diverse Compositions From Global Views. CVPR, 2022.
[3] Zhiyu Pan, Yinpeng Chen, Jiale Zhang, Hao Lu, Zhiguo Cao, and Weicai Zhong. Find Beauty in the Rare: Contrastive Composition Feature Clustering for Nontrivial Cropping Box Regression. AAAI, 2023.
[4] Zhiyu Pan, Zhiguo Cao, Kewei Wang, Hao Lu, and Weicai Zhong. TransView: Inside, Outside, and Across the Cropping View Boundaries. ICCV, 2021.
[5] Chao Wang, Li Niu, Bo Zhang, and Liqing Zhang. Image Cropping With Spatial-Aware Feature and Rank Consistency. CVPR, 2023.
[6] Yukun Su, Yiwen Cao, Jingliang Deng, Fengyun Rao, and Qingyao Wu. Spatial-Semantic Collaborative Cropping for User Generated Content. AAAI, 2024.
Questions for authors
Check the weakness.