- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes FrameLite, a compact aesthetic image cropping framework built upon Qwen3.5-0.8B. To overcome the limitations of small models in generating high-quality bounding boxes directly in a single pass, the authors introduce a three-stage training paradigm. FrameLite achieves competitive performance on benchmarks.
Critical strengths
-
Addresses real-world mobile deployment demands by downsizing VLM-based cropping to 0.8B while maintaining single-pass inference speed.
-
Outperforms or matches several much larger 7B-class baselines across public aesthetic cropping datasets.
Critical weaknesses
-
QOS and GRO essentially re-package established LLM alignment techniques (RAFT / Rejection Sampling and SCST / Policy Gradient) without tailoring core loss functions specifically to aesthetic/geometric bounds.
-
The Best-of-N gap is an inherent statistical property of sampling in generative models rather than a unique untapped trait of small models.
-
It is unclear how much performance stems from the strong Qwen3.5-0.8B base and extensive Stage I supervision versus the proposed QOS/GRO alignment. Ablations on weaker/alternative sub-1B backbones are missing.
-
The paper lacks an evaluation of subjective diversity in cropping (e.g., diversity metrics or a user study reporting blind preference win rates).
-
In image cropping, user inputs may contain extreme aspect ratios (such as ultra-wide panoramas, ultra-tall vertical streetscapes, or macro photography). How sensitive is the VLM to extreme resolutions and extreme aspect ratios when linearizing coordinates into tokens?
-
There is a lack of bucketed performance analysis on images with extreme aspect ratios, low-light conditions, or complex occlusions. Is the model prone to degenerating into outputting default full-frame boxes or corrupted coordinates under these corner cases?
Questions for authors
See above.
2 comments
A Third Gentle Follow-up on Our Rebuttal
Dear Reviewer ZTP2,
As the discussion period will close shortly, we would like to send a final gentle reminder. We would be truly grateful if you could take a moment to revisit our rebuttal and let us know whether it addresses your concerns.
Thank you again for your time and consideration.
Best regards, The Authors
Response to Reviewer ZTP2 (R3)
Q3-1QOS/GRO re-package RAFT/SCST without crop-specific losses.A3-1Thank you for the comment. We respectfully disagree: we design three crop-specific components.Composition loss. For multiple acceptable framings, Stage I combines three terms (Eq. 4) rather than one reference: an anchor term for a concrete answer, a listwise term aligning candidate rankings with human scores, and a high-quality-set term raising top crops' total probability without fixing its allocation. With anchor supervision only, all six final metrics drop (FCDB IoU .7124→.7055, Table 2).
QOS candidate selection. QOS adds the greedy answer to the K samples and prefers it on ties (Eq. 7). It learns a better sample if one exists and otherwise reinforces the greedy decision, so the target never scores below the greedy answer and ties never switch targets.
Complete-frame reward. QOS and GRO share a terminal reward on the complete crop: high-quality-set agreement with acceptance thresholds (GAIC), score-weighted multi-reference IoU (CPC), and single-reference IoU (FCDB), with source weights. GRO uses the reward gap to the greedy crop as a signed advantage (Eqs. 9–10), reinforcing better crops and suppressing worse ones in proportion, so human preferences shape the policy via geometric feedback.
The QOS→GRO order is also a contribution: QOS improves the greedy crop via selection; GRO then refines it with signed quality differences, outperforming continued QOS (Table 3b).
Q3-2Best-of-N gains are inherent to sampling, not unique to small models.A3-2Thank you for the comment. We agree that the Best-of-N gain is a general property of sampling, as also shown by Song et al. [1] and Beirami et al. [2]. The paper uses it only as motivation; its contributions (p. 2) are the compact cropping model, QOS, and GRO. Figure 1b shows candidate potential beyond the greedy output, motivating learning from candidate quality differences to improve the single prediction. We will add these citations and clarify this positioning.[1] Song et al. The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism. NAACL, 2025. [2] Beirami et al. Theoretical Guarantees on the Best-of-n Alignment Policy. ICML, 2025.
Q3-3How much do gains come from Qwen3.5-0.8B and Stage I vs. QOS/GRO?A3-3Thank you for the suggestion. QOS/GRO add consistent gains beyond both. On four added backbones (FastVLM-0.5B, InternVL3-1B, Qwen3.5-2B/9B), QOS and GRO bring stage-wise improvements; with FastVLM-0.5B or InternVL3-1B, FrameLite also beats the 7B-class Venus on GAICv2 and FCDB (Tables R1–R2 in A1-4).Contribution of QOS and GRO. From Stage I (Table 2), QOS and GRO add 1.0/5.0 pp on GAICv2 Acc.85/Acc.90 and .0167/.0111 IoU on FLMS/FCDB. On FLMS, excluded from crop training, they lift FrameLite from .8512 (below Venus's .8638) to .8679.
Role of Stage I. Under the same later training (Table 2), omitting localization (FLMS IoU .8679→.8553) or using anchor supervision only (FCDB IoU .7124→.7055) lowers all six final metrics, so spatial grounding and multi-candidate supervision both contribute.
Q3-4Is there a blind study? Can the model give multiple plausible crops?A3-4Thank you for the question. Yes to both.Q3-5How sensitive are coordinates to extreme resolutions and aspect ratios?A3-5Thank you for the suggestion. FrameLite is robust to both. We added 450 original images and 50 proportionally rescaled versions: ultra-wide panoramas (WildPASS, 5.12:1), macro photos (MMP-2K), and real vertical and high-resolution photos (Wikimedia Commons; up to 7.18:1 height-to-width). All 500 inputs yield valid coordinates. Across the 50 resolution pairs, predicted-box IoU averages 0.9391 (median 0.9862).Q3-6Is the model prone to full-frame or corrupted outputs under low light or occlusion?A3-6Thank you for the question. No. We checked outputs on 100 low-light images (ExDark) and 100 clearly occluded images (official ASW occlusion labels). No group shows runtime errors, invalid coordinates, or tiny boxes in raw outputs without coordinate repair or fallback. Only 7 of the 450 original images (1.6%) yield an exact full-image crop, so the full frame is not a dominant strategy but remains a valid option.