- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Region-Level Composition Target Prediction, a task that predicts the desired spatial arrangement of semantic regions in a photograph. The predicted targets include region bounding boxes, centroids, visible areas, frame aspect ratio, and person framing.
To construct training supervision, the authors derive AesRecon-CT from existing source-reference photograph pairs. They establish partial region correspondences between source and reference images and transfer the reference geometry to the corresponding source regions.
The proposed model, NextShot, combines three components: a region-frame relational encoder, graph-conditioned multimodal fusion with a pretrained VLM, and a framing-conditioned geometry decoder. The model is jointly trained using reference-derived geometric supervision and auxiliary aesthetic annotations from PortraitCraft.
Experiments demonstrate improvements in geometric prediction accuracy over several baselines. Two VLM-based evaluators generally prefer the predicted layouts from NextShot over alternative methods. Furthermore, a guided photography study reports that human evaluators prefer photographs taken with NextShot guidance in 78% of judgments.
Critical strengths
- The task formulation is interesting and potentially useful to real-world applications.
- The source-reference supervision construction is reasonably designed.
- The experimental evaluation is relatively comprehensive.
Critical weaknesses
- User study contains only five people, which might be biased.
- The improvements in geometric accuracy are relatively modest, and there is apparently some trade-offs.
- Since the task is to give a better camera pose, why not just use bbox? This paper argues that these attributes capture complementary geometric information, but there seems no ablation tests on it, such as bbox-only, centroid-and-area, and the full representation. Ideally, if bbox prediction is accurate, it should be more than enough to guide photographer. More importantly, these variants should ideally be evaluated through composition preference rather than geometric accuracy alone, since their output spaces are different.
- The VLM-based layout evaluation lacks human validation. The paper relies heavily on two VLM evaluators to assess the quality of predicted layouts and demonstrate the effectiveness of the architectural components. While the paper conducts a human preference study on the actual photographs before and after guided recapture, this does not validate the VLM-based evaluation of the predicted layouts. In particular, no human evaluation is provided to verify whether the improvements over architectural ablations are consistent with human preferences. This is concerning because the two VLM evaluators sometimes disagree substantially, such as in the comparisons with NoVLM-AttrAux and NextShot-8B. I would like to see a human preference evaluation on a subset of the predicted layouts and an analysis of human–VLM agreement.
Questions for authors
See weakness 3 and 4.
5 comments
Response to Reviewer NtBg (2/3)
W3. Why predict bounding boxes, visible centroids, and visible areas jointly? Are bounding boxes alone sufficient?
Thank you for pointing out that the choice of geometric representation needed further validation. We agree. We trained a BBox-only model and used geometric metrics, model evaluations, and human layout comparisons to test whether bounding boxes alone suffice to predict the composition.
(1) Are bounding boxes alone sufficient?
We ran additional ablations to address this question directly.
| Model | Overall box IoU ↑ | Person box IoU ↑ | Environment box IoU ↑ | Centroid MAE ↓ | Area MAE ↓ | Frame aspect-ratio error ↓ |
|---|---|---|---|---|---|---|
| Full NextShot | 0.6373 | 0.5973 | 0.6630 | 0.0659 | 0.0670 | 4.07% |
| BBox-only | 0.6362 | 0.5998 | 0.6600 | — | — | 3.79% |
| Centroid-and-area | — | — | — | 0.0665 | 0.0634 | 3.31% |
To examine what these geometric fields contribute to the overall composition, we asked Qwen, Flash, and human evaluators to compare the predicted layouts.
| Evaluator | Full NextShot | BBox-only | Tie |
|---|---|---|---|
| Qwen | 58.00% | 35.75% | 6.25% |
| Flash | 53.50% | 33.00% | 13.50% |
| Human evaluators | 221 (73.7%) | 7 (2.3%) | 72 (24.0%) |
We also examined the layouts predicted by the two models in individual scenes. We found that NextShot better captured spatial relationships between objects. For example, in a scene with a person and a chair, BBox-only assigned the chair a relatively large region, making the chair appear too large relative to the person. NextShot predicted a more plausible relative scale and placement for the person and the chair, producing a more coherent layout.
The value of this design goes beyond adding prediction fields or inputs. By jointly modeling the spatial extents of regions and incorporating information such as scene depth, NextShot can better capture and predict how people and their surroundings are arranged.
Response to Reviewer NtBg (3/3)
W4. Do human judgments support the VLM layout evaluations? Do people and models show the same overall preferences?
Thank you for raising this question. Other reviewers also raised this issue and suggested repeating the evaluation with candidate positions swapped. We revised the Flash evaluation to use the same position assignments as Qwen. To test the stability of the results, we then reversed the candidate order within each pair and evaluated the same pairs again.
(1) Do the main model comparisons remain stable under the revised protocol?
For the same set of test pairs, we first placed NextShot in position A for 100 pairs and in position B for the other 100. We then swapped the two candidates within each pair and repeated the evaluation.
| Compared method | Flash win rate | Flash win rate after swap |
|---|---|---|
| NoChange | 59.5% | 66.5% |
| AR-8B | 72.5% | 76.0% |
| NoVLM-AttrAux | 53.5% | 52.5% |
| w/o AesAux | 73.5% | 71.0% |
| w/o RelBias | 67.5% | 66.5% |
| w/o Framing Conditioning | 54.5% | 51.5% |
For NoVLM-AttrAux, balancing candidate positions substantially narrowed the gap between the two evaluators, although some disagreement remained. We examine this comparison further below using the human layout judgments.
(2) How does presentation order affect model preferences?
Our observations are consistent with earlier work on position bias in multi-image vision-language models. Tian et al. [1] found that the position of an image can influence these models’ judgments. Hu et al. [2] evaluated each candidate pair in both orders to reduce the influence of presentation order on multimodal preference judgments. These studies help explain the sensitivity we observed and support evaluating preferences in both orders. Although the models’ layout preference rates varied, the overall pattern continued to favor our method.
(3) Do human evaluators also prefer the full model’s layouts?
To test directly whether the predicted layouts reflect human preferences for composition, we invited three professional photographers to assess the same 100 test scenes in a blind evaluation. They considered the person’s position and size, the relationship between the person and the surroundings, and the overall arrangement within the frame.
| Method compared with full NextShot | Preferred full model | Preferred other model | Rated equally |
|---|---|---|---|
| NoVLM-AttrAux | 164 (54.7%) | 24 (8.0%) | 112 (37.3%) |
| w/o Framing Conditioning | 208 (69.3%) | 13 (4.3%) | 79 (26.3%) |
| NextShot-8B | 202 (67.3%) | 11 (3.7%) | 87 (29.0%) |
| BBox-only | 221 (73.7%) | 7 (2.3%) | 72 (24.0%) |
The photographers’ preferences provide further support for the full model and its core design choices. The full model’s advantage over NoVLM-AttrAux was limited in the automated evaluation. This suggests that NoVLM-AttrAux already produces strong structured layouts that differ only slightly from those of the full model. Even so, the photographers cast more votes for the full NextShot model when they compared the layouts directly.
We also evaluated both presentation orders to examine why Qwen and Flash originally favored different models in the 4B versus 8B comparison. Flash selected the 4B model in 56% of judgments and the 8B model in 36%. The human evaluators also showed a clear preference for the 4B model in the layout comparison. Both the automated judgments and the photographers’ preferences support our choice of the 4B configuration. For this task and training setup, a larger backbone offered no clear gain in layout preference.
These additional experiments give us a fuller picture of the automated evaluation results and further support the full NextShot model’s advantage in the main architectural comparisons. We will include these findings in the revised manuscript.
Thank you again for your detailed and constructive feedback. We hope these revisions address your concerns and give you greater confidence in the technical soundness and research contributions of our work.
References:
[1] Tian et al., “Identifying and Mitigating Position Bias of Multi-image Vision-Language Models,” CVPR 2025.
[2] Hu et al., “Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image,” CVPR 2026.
Response to Reviewer NtBg (1/3)
Thank you for recognizing the merits of our work and for your careful review and constructive feedback. We address your concerns in turn below.
W1. Size of the user study
Thank you for pointing out the limited size of the user study. We used several complementary evaluations to examine different aspects of NextShot’s effectiveness. We added a human evaluation of predicted layouts to assess whether the model’s composition targets reflect people’s preferences and are meaningful in practice. The recapture study also helped us assess how well the human judgments carry over to actual photographs and whether photographers can use NextShot’s spatial guidance to improve their shots.
We agree that a systematic study with a more diverse group of photographers, subjects, and evaluators, across a wider range of shooting conditions, would help establish how broadly the method applies.
W2. Modest gains in geometric accuracy and trade-offs across metrics
Thank you for highlighting the trade-offs among the geometric metrics. We believe these arise in part from the nature of the composition task. The metrics measure different properties of a predicted layout, including each region’s spatial extent, the centroid of its visible content, its visible area, and the aspect ratio of the frame. Improvements in these properties need not occur together.
Geometric metrics primarily measure how closely a prediction matches a reference composition. They do not directly measure the quality of the composition as a whole. We therefore assess NextShot using regional agreement with the reference geometry, preferences for the overall layout, and the quality of the resulting photographs. This gives a broader assessment of composition than any single geometric error. In direct comparisons of the predicted layouts, human evaluators showed a clear preference for the full model.