- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents GOT-Align, a generative image enhancement framework that aims to achieve three goals: generating diverse retouching results from a single input image, supporting spatially varying local adjustments, and adapting the generation process to user preferences through comparative feedback.
The proposed method builds upon bilateral affine grids and introduces a VQ-based Generative Operation Tokenizer (GOT) to learn a discrete codebook of reusable retouching operations. An image-conditioned autoregressive Transformer is then trained to model the distribution of these operation tokens, enabling multiple plausible enhancements for the same input. Finally, the authors introduce a localized preference alignment strategy, where human or VLM judges compare generated results at the regional level. The resulting preferences are mapped to corresponding operation tokens and used to fine-tune the autoregressive predictor through GRPO, allowing the model to generate preference-aligned enhancements without explicit editing instructions.
Critical strengths
1. A clear and intuitive framework for preference-aligned image enhancement.
The overall idea is good. Instead of directly generating enhanced images, the method learns reusable local retouching operations and models their compositions. Using regional preference feedback to guide GRPO is also a reasonable idea, as it connects subjective aesthetic judgments with local editing decisions.
2. A compact representation for generative enhancement.
The VQ-based codebook provides a compact way to represent retouching transformations. By modeling spatially varying operations as discrete tokens, the method can reduce the complexity of generation while sharing a common set of operations across different images. This is a promising direction for efficient enhancement, although the actual efficiency gains still need to be demonstrated.
Critical weaknesses
1. The choice of bilateral grids and the diversity of the learned operation space are not well justified.
I am not fully convinced why bilateral grids are particularly suitable for the proposed generative framework. While they are efficient and support spatially varying transformations, the paper does not explain why they are preferable to other retouching representations in this setting.
More importantly, there is little evidence that the learned operation space actually captures meaningful diversity. GOT learns a codebook of 512 tokens, but it is unclear (1) whether these tokens represent genuinely different operations or contain substantial redundancy, (2) whether different token compositions produce perceptually different results rather than just different bilateral grids, and (3) whether these operations can be reused across different images. The authors claim that their representation enables diverse retouching transformations (Section 3.1), but provide neither quantitative diversity analysis nor visualizations of the editing effects of different operation tokens.
I am also concerned about the lack of explicit regularization or analysis of the generated bilateral grids. Large differences in affine coefficients between neighboring grid cells could lead to unnatural local color transitions. Although bilateral slicing provides some smoothing, it does not necessarily guarantee visually coherent results. The paper does not discuss whether such artifacts occur or whether additional spatial regularization is needed.
2. The benefit of localized preference alignment over global preference optimization is not demonstrated.
One of the main contributions is the proposed regional preference alignment, which maps local judgments to operation tokens for more precise credit assignment. However, the experiments do not show why this is better than conventional image-level preference optimization.
Table 3 only compares GOT with GOT after localized GRPO training. This shows that preference optimization helps, but does not isolate the contribution of localized credit assignment. A much simpler approach, such as assigning one global reward to the entire token sequence and applying standard GRPO, might achieve similar or even better results.
I would expect at least two additional baselines: GOT + Global GRPO, using image-level rewards, and GOT + Regional GRPO, where regional preferences are aggregated into a single reward rather than assigned to individual tokens. Without these comparisons, it is hard to tell whether the proposed localization is actually necessary.
Another concern is the assumed correspondence between image regions and operation tokens. Since the output is generated through a learned decoder and bilateral slicing, a single token can potentially affect multiple regions. Simply projecting superpixel preferences onto spatially corresponding tokens does not necessarily give accurate credit assignment. This assumption needs more justification or experimental evidence.
3. GRPO may compromise the generative diversity that the paper aims to achieve.
The paper repeatedly emphasizes that GOT can generate diverse retouching results, but the autoregressive predictor is directly fine-tuned using GRPO during preference alignment. This could push the model toward a small set of high-reward operations, reducing the diversity of the original generative distribution or even causing mode collapse.
This seems particularly important because the authors claim to achieve both diverse generation and preference alignment. However, there is no analysis of how GRPO affects the learned distribution. Surprisingly, the main comparisons also use greedy decoding, which does not really demonstrate the claimed generative capability.
I would like to see multiple sampled results from the same input, both before and after GRPO, along with quantitative diversity measurements. Otherwise, it is difficult to tell whether GOT-Align still produces diverse enhancements or simply learns to generate a narrower set of preferred results.
4. The experimental evaluation is not fully convincing, especially regarding GT comparisons and personalization.
First, both MIT-Adobe FiveK and PPR10K provide expert-retouched ground truths. The authors select Expert C and Expert A as the reference styles for the respective benchmarks, yet none of the qualitative comparisons include the corresponding GT images. The paper also reports no GT-based metrics, such as PSNR or SSIM, for the complete generative model.
I understand that preference-based evaluation is reasonable for a one-to-many enhancement task. However, comparing against expert-specific baselines using only VLM/human preferences may not be entirely fair. For example, if an expert prefers a darker style, a baseline that faithfully reproduces that style might lose simply because the VLM judge prefers brighter images. This does not necessarily mean GOT produces a better result. Showing the GT images and reporting reference-based metrics would make the comparisons more informative.
Second, I do not think the experiments convincingly demonstrate personalized preference learning. Most results reflect general aesthetic preferences from VLMs or a small group of human evaluators, rather than adaptation to different users with distinct preferences. Why not evaluate on the Personalized Photographic Style Dataset (PPSD) from Learning Personalized Photographic Style from Pairwise User Preferences (CVPR 2026)? This dataset contains pairwise preferences from 767 users and seems much more relevant to the proposed task.
As it stands, the experiments provide stronger evidence for general perceptual quality improvement than for actual user-specific preference alignment.
5. Current writing is poor and hard to follow and lacks of relevant works.
The related work discussion is quite limited, especially for preference-based image enhancement. For example, PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouching (AAAI 2026) is only briefly discussed, while Learning Personalized Photographic Style from Pairwise User Preferences (CVPR 2026), which addresses a closely related problem, is not mentioned. A clearer comparison with these works would help establish what is actually new in GOT-Align.
The Method section also leaves several important details unclear. For example, how exactly are pairwise regional judgments aggregated into preference scores? How are these scores projected onto operation tokens, especially when their spatial effects may overlap? Equation (3) only defines the token-level advantage, without explaining the complete GRPO objective. The architectures of the tokenizer and autoregressive predictor are also insufficiently described.
These are not minor implementation details, as they are directly related to the proposed contributions. The current description makes it difficult to understand the exact optimization procedure or reproduce the method.
Questions for authors
The following experiments would help address my main concerns and could improve my assessment:
-
Localized vs. Global GRPO (most important). Please compare the proposed method with GOT + Global GRPO and GOT + Regional GRPO with aggregated rewards, under the same training budget. A clear improvement from token-level credit assignment would substantially strengthen the main contribution.
-
Generative diversity analysis. Please provide quantitative diversity measurements and multiple sampled results before and after GRPO, along with codebook utilization statistics. This would help verify that the learned operations are genuinely diverse and that preference alignment does not lead to mode collapse.
-
Personalized preference evaluation. Please consider evaluating on PPSD (CVPR 2026) or a similar user-specific preference dataset. Demonstrating adaptation to different users, especially those with conflicting preferences, would make the personalization claim much more convincing.
-
GT-based comparisons. Please include the expert GT images in qualitative comparisons and report PSNR/SSIM for the complete model alongside preference scores. This would help clarify whether the improvements come at the cost of fidelity to the target expert styles.
Positive results on the first two points, together with stronger evidence of user-specific adaptation, would be particularly important in reconsidering my assessment.
4 comments
W3. Diversity after GRPO and greedy decoding
We added Sec. 4.4 and Table 6 to compare stochastic samples before and after GRPO. GOT-Align retains substantial diversity in both image space and token space under the tested sampling settings.
The main quantitative comparisons use greedy decoding to produce one reproducible output per input, following the single-output protocol used for the predominantly deterministic baselines and avoiding selection among generated candidates. The separate sampling experiment evaluates the model’s one-to-many generation. All five sampled retouches for each evaluated input remain distinct in both image space and token space after alignment.
Table 6. Sample diversity before and after GRPO
| Metric | FiveK GOT | FiveK GOT-Align | PPR10K GOT | PPR10K GOT-Align |
|---|---|---|---|---|
| Pairwise LPIPS | 0.09 | 0.08 | 0.06 | 0.06 |
| Token difference rate (%) | 98.66 | 98.57 | 97.52 | 97.43 |
| Codebook utilization (%) | 90.23 | 89.65 | 89.06 | 89.06 |
| Codebook entropy (bits) | 8.17 | 8.05 | 8.27 | 8.21 |
| Codebook perplexity | 287.22 | 264.35 | 309.16 | 296.45 |
W4. Evaluation objective, personalization, and PPSD
We use blinded pairwise comparisons to evaluate the full model’s outputs, and Table 5 shows that GOT-Align can adapt to the preferences expressed by different feedback sources.
FiveK and PPR10K provide multiple expert retouches per input. As described in Sec. 4.1, we use Expert C on FiveK and Expert A on PPR10K to standardize the comparison setting, since most baselines are deterministic and produce one retouch per input. In our pairwise evaluation, judges assess overall photographic appearance with method identities hidden. GOT-Align achieves 57.1%–66.1% HMOS across the reported baseline comparisons.
In Table 5, each aligned variant is evaluated against the same pre-alignment GOT model. The Qwen-aligned variant receives a higher preference rate under Qwen evaluation, and the human-aligned variant receives a higher HMOS under human evaluation. This pattern is clearest on FiveK. We plan a follow-up experiment to test whether the model can adapt separately to individual users with conflicting retouching preferences.
Table 5. Pairwise preference rate (%) for each aligned variant over pre-alignment GOT
| Dataset | Alignment feedback | Qwen | GPT-5.6 Luna | HMOS |
|---|---|---|---|---|
| FiveK | Qwen | 66.7 | 62.1 | 58.8 |
| FiveK | Human | 61.3 | 64.2 | 65.3 |
| PPR10K | Qwen | 64.4 | 64.5 | 58.5 |
| PPR10K | Human | 62.5 | 57.9 | 58.6 |
PPSD provides one preference label per whole-image pair. Our localized alignment requires a preference label for each annotated region. A user may prefer the subject in one candidate and the background in another, while a whole-image label records only the overall choice. Using PPSD with our current localized objective would therefore require additional region-level annotations.
W5. Method details and related work
We revised Sec. 3.2 to explain regional score aggregation and added Eqs. (3) and (5) to specify the projection and training loss. We also expanded Sec. 2.1 to discuss PerTouch and Kim et al.’s work on personalized photographic style. Appendix Sections A.4 and A.5 now provide additional details on the model architectures and training.
Each regional pairwise judgment assigns a weighted positive score to the preferred candidate and an equal negative score to the other. An unreported region contributes zero for that comparison. For each candidate, we normalize the accumulated regional scores by the number of successful comparisons involving that candidate. After projecting the scores with Eq. (3), we subtract the mean across the candidates at the same token position to obtain the group-relative advantage.
A_t^{(n)} = q_t^{(n)} - \frac{1}{N}\sum_{j=1}^{N} q_t^{(j)}. \tag{4}
The new Eq. (5) applies this localized advantage in the clipped GRPO loss.
\ell_t^{(n)} = -\min\bigl(\rho_t^{(n)} A_t^{(n)}, \operatorname{clip}\bigl(\rho_t^{(n)}, 1 - \epsilon, 1 + \epsilon\bigr) A_t^{(n)}\bigr) + \beta\widehat{D}_t^{(n)}. \tag{5}
Here, is the current-to-rollout policy probability ratio, and is the sampled-token KL estimate relative to the frozen pre-alignment policy. Both the policy and KL terms contribute only at positions with nonzero localized advantage.
Sec. 2.1 now explains how PerTouch translates user instructions into semantic-region controls and uses scene-aware memory, and how Kim et al. (2026) learn personalized photographic style from whole-image pairwise preferences. GOT-Align uses region-level comparisons to adapt a generative policy over reusable local operations.
Q1. Localized vs. Global GRPO
The new Table 4 shows that GOT-Align is preferred over both scalar-reward GRPO baselines on both datasets under all three evaluators. The comparison with Regional GRPO is particularly informative because both methods use regional judgments. GOT-Align preserves their spatial assignment to token positions, while Regional GRPO aggregates them into a candidate-level reward.
Table 4. Pairwise preference rate (%) for GOT-Align over each scalar-reward baseline
| Dataset | Baseline | Qwen | GPT-5.6 Luna | HMOS |
|---|---|---|---|---|
| FiveK | Global GRPO | 55.8 | 54.6 | 54.3 |
| FiveK | Regional GRPO | 58.5 | 53.5 | 55.4 |
| PPR10K | Global GRPO | 52.3 | 53.4 | 56.2 |
| PPR10K | Regional GRPO | 54.3 | 54.8 | 55.4 |
Q2. Generative diversity
The new Table 6 quantifies the diversity retained after GRPO. Fig. 6 in the appendix shows the diversity of samples generated by GOT and GOT-Align.
In Sec. 4.4, we sample five retouches per input from each model using matched random seeds, a temperature of 1.0, and top- of 1.0. Pairwise LPIPS shows only a small decrease after alignment, and codebook utilization stays above 89%. All five samples for each evaluated input remain distinct in both image space and token space.
Table 6. Sample diversity before and after GRPO
| Metric | FiveK GOT | FiveK GOT-Align | PPR10K GOT | PPR10K GOT-Align |
|---|---|---|---|---|
| Pairwise LPIPS | 0.09 | 0.08 | 0.06 | 0.06 |
| Token difference rate (%) | 98.66 | 98.57 | 97.52 | 97.43 |
| Codebook utilization (%) | 90.23 | 89.65 | 89.06 | 89.06 |
| Codebook entropy (bits) | 8.17 | 8.05 | 8.27 | 8.21 |
| Codebook perplexity | 287.22 | 264.35 | 309.16 | 296.45 |
Q3. Personalized preference evaluation
Table 5 supports adaptation to different feedback sources. We plan to test individual personalization with users who have conflicting retouching preferences.
Each variant is compared with the same pre-alignment GOT model. The source-specific pattern is clearest on FiveK. The Qwen-aligned variant scores 66.7% vs. 61.3% under Qwen evaluation, and the human-aligned variant scores 65.3% vs. 58.8% under human evaluation. PPSD provides whole-image preference labels. Using it with our current localized alignment objective would require additional region-level annotations.
Table 5. Pairwise preference rate (%) for each aligned variant over pre-alignment GOT
| Dataset | Alignment feedback | Qwen | GPT-5.6 Luna | HMOS |
|---|---|---|---|---|
| FiveK | Qwen | 66.7 | 62.1 | 58.8 |
| FiveK | Human | 61.3 | 64.2 | 65.3 |
| PPR10K | Qwen | 64.4 | 64.5 | 58.5 |
| PPR10K | Human | 62.5 | 57.9 | 58.6 |
Q4. Ground-truth comparisons
Our task does not assign a single ground-truth retouch to each input because GOT-Align aims to learn the different aesthetic preferences users have for the same photograph. Multiple retouches of a photograph can be valid for users with different preferences. Existing supervised retouching methods typically train on fixed target edits provided by one or a small number of experts.
We use blinded pairwise comparisons to test whether GOT-Align’s outputs better match evaluators’ aesthetic preferences than the outputs of these methods. As shown in Tables 1 and 2, human evaluators preferred GOT-Align’s outputs in 57.1%–66.1% of pairwise judgments across the reported baseline comparisons (HMOS).
Good rebuttal
Thank you for the detailed rebuttal and the substantial effort put into revising the paper. I appreciate that the authors have carefully addressed my concerns.
However, I still feel that the original submission was too preliminary and lacked sufficient depth. One remaining concern is that the visual differences between GOT and GOTalign are barely noticeable across the figures, making it difficult to appreciate the practical benefits of the proposed alignment.
While the extensive revisions have certainly improved the paper, they also represent a substantial change from the original submission. I would therefore prefer to maintain my rating of Weak Reject and leave it to the AC to judge whether revisions of this scale are appropriate at the rebuttal stage.
I appreciate the authors' efforts and am happy to defer to the AC's final assessment.
Dear Reviewer f3Bm,
We thank the reviewer for recognizing the intuitive design of GOT-Align, the compactness of its operation representation, and the motivation for learning from regional preference feedback.
W1. Bilateral grids, operation diversity, and spatial coherence
We use bilateral grids to model spatially varying retouching operations. We updated Fig. 1 and Sec. 3.1 to clarify the renderer and added Tables 3 and 6 to quantify inference efficiency and sample diversity. We also added Fig. 6 in the appendix to visualize sampling diversity.
Why bilateral grids. An image-adaptive global 3D LUT selects a color mapping for each input, and all locations within that image share the mapping. Following HDRNet, our renderer slices a bilateral grid using each pixel’s spatial coordinates and an input-derived guidance value. This yields per-pixel affine transforms that can adjust the subject and background differently even when their input RGB values are similar. The spatially varying representation lets us model local editing decisions and associate them with regional preference feedback.
Operation diversity and reuse. Table 6, reproduced in W3, shows that sampled token maps use 89.06%–90.23% of the 512-entry codebook. Pairwise LPIPS measures perceptual differences between retouches produced by different token compositions. We train one codebook per dataset to accommodate differences in photometric distributions, such as brightness and saturation. After Stage 1, the codebook is frozen, and the predictor reuses the same operation vocabulary across images within that dataset.
Spatial coherence. In Stage 1, we train GOT end to end using reconstruction MSE on the final rendered image together with the VQ objective. When a local color transition deviates from the training target, the affected pixels contribute to the reconstruction error, and gradients reach the networks that produce the grid and guidance map. Bilateral slicing also interpolates neighboring affine coefficients, which helps reduce abrupt grid-boundary transitions. We did not observe visible grid-boundary artifacts in the outputs we inspected and used no separate spatial smoothness penalty. In Stage 2, GOT remains frozen, and we train the autoregressive predictor with cross-entropy on the operation tokens.
Inference efficiency. The new Table 3 in Sec. 4.2 reports mean latency over 500 images at 340p on an NVIDIA RTX 4090 with a batch size of one. Timing starts with preprocessed inputs and ends when the predicted retouching transform is ready to apply.
Table 3. Inference efficiency
W2. Localized credit assignment and region-to-token correspondence
We added Table 4 in Sec. 4.3 to test token-level credit assignment against Global GRPO and Regional GRPO, and added Eq. (3) in Sec. 3.2 to specify the many-to-many projection from regions to token positions.
Global GRPO derives one scalar reward per candidate from whole-image judgments. Regional GRPO pools regional judgments into one scalar reward per candidate. Comparing GOT-Align with Regional GRPO tests the value of retaining the spatial origin of the feedback when both methods use regional judgments. For example, if a candidate receives positive feedback for the subject and negative feedback for the background, GOT-Align can retain both signals at different token positions. Its preference rate exceeds 50% against both baselines on both datasets under all three evaluators.
Table 4. Pairwise preference rate (%) for GOT-Align over each scalar-reward baseline
We agree that a token position can affect multiple regions. Let κpt be the renderer’s spatial bilinear interpolation weight between pixel p and token position t, and let Sm(n) be the signed preference score for candidate n in region Rm. The new Eq. (3) computes the total interpolation weight Bmt linking a region to a token position and uses it to obtain a localized score qt(n).
q_t^{(n)} = \frac{\sum_{m=1}^{M} B_{mt} S_m^{(n)}}{\sum_{m=1}^{M} B_{mt}}. \tag{3}$$ **A region can contribute to several token positions, and a position can receive weighted feedback from several regions.** Opposing regional scores offset each other according to their interpolation weights. The renderer’s interpolation provides a spatial approximation for assigning credit, and Table 4 measures the effect of using this assignment.