- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents LumaGuide, a framework for HDR generation using frozen pretrained diffusion models. It guides sampling by aligning PQ-space luminance histograms with target distributions through a differentiable Wasserstein-1 objective, and extends the approach to video with temporal luminance regularization. The idea is simple yet effective.
Critical strengths
LumaGuide achieves competitive HDR generation quality without fine-tuning the pretrained diffusion backbone or VAE, offering a practical way to reuse existing models.
Critical weaknesses
The idea is simple yet effective, and the experimental evaluation is generally sound. I appreciate the authors’ efforts. Addressing the following points would help clarify the method and strengthen the evaluation.
-
Histogram alignment alone does not establish plausible highlight placement or local detail. Please provide targeted highlight/shadow analysis and a post-generation histogram-matching baseline using the same backbone and target distribution.
-
Please clarify the conversions between decoder RGB, linear luminance, and PQ, and explain how baseline outputs are calibrated to absolute luminance in nits.
-
The MLP’s KL scores are difficult to interpret without a simple baseline, such as the mean training histogram. Predicted-versus-ground-truth histogram plots, percentile errors, and evaluation on external HDR datasets would strengthen validation.
-
A distribution-level metric, such as FID computed using consistent tone mapping and sufficient samples, would complement the luminance statistics and subjective assessment. Please also specify the display hardware, luminance capabilities, color management, and viewing conditions used in the user study.
-
TLC and fixed-pixel temporal variance can penalize legitimate motion and illumination changes. Please provide playable HDR videos and motion-aware evaluation. Video comparisons currently cover backbone ablations only; an additional baseline could combine the same SDR video generator with the HDR conversion method in [2].
-
Please summarize the key limitations discussed in Appendix A.11 in the main text.
-
As an optional addition, a downstream application such as image-based lighting could better demonstrate the benefits of HDR generation, which are not always evident in the current comparisons with vanilla FLUX.
The related-work discussion should also include:
[1] Linear Image Generation by Synthesizing Exposure Brackets. CVPR 2026.
[2] Generating HDR Video from SDR Video. SIGGRAPH Asia 2026.
[3] GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild. ICCV 2023.
Questions for authors
Please refer to the weaknesses.
5 comments
Response to W3: Text-to-Histogram Regressor Validation
We thank the reviewer for suggesting a more comprehensive evaluation of the text-to-histogram regressor. We have introduced a mean training histogram baseline and additional distributional and percentile-based metrics, and further evaluated the regressor on an external HDR dataset.
On the held-out test set, comprising 1,123 frames from source-video-disjoint content, the MLP outperforms the mean training histogram baseline, reducing KL divergence from 0.459 to 0.346 (approximately 25%), PQ-domain W1 from 0.098 to 0.068 (approximately 31%), and P50 error from 0.112 to 0.077 (approximately 31%). P99 error also decreases from 0.047 to 0.044. These results demonstrate that text conditioning provides predictive information beyond the dataset-average luminance distribution.
To assess cross-dataset generalization, we additionally evaluate the regressor without further training on an independent dataset, LIVE Paired Comparison HDR vs. SDR Database, of professionally graded HDR10 content (48 videos, 192 frames). The MLP achieves lower median KL divergence (0.355 vs. 0.407) and PQ-domain W1 (0.098 vs. 0.110) than the mean histogram baseline, indicating that text conditioning retains predictive value across domains. While differences in luminance distributions and creative grading practices may affect performance, LumaGuide does not depend on the text-to-histogram regressor: target histograms can also be specified through predefined presets or HDR reference images.
In the revised manuscript, we have expanded Appendix A.7 with the mean training histogram baseline and additional distributional and percentile-based metrics, and clarified the potential domain limitations of training on UGC HDR content.
Response to W4: Distribution-Level Evaluation and Subjective Study Setup
We thank the reviewer for highlighting the importance of distribution-level evaluation beyond target-histogram alignment. While FID and KID measure overall image-distribution similarity in Inception feature space, they are influenced by semantic content and may be less sensitive to HDR-specific luminance characteristics. Since LumaGuide primarily aims to improve luminance distributions rather than alter image semantics, we additionally evaluate the Wasserstein-1 distance between the pooled PQ-luminance distributions of generated images and real HDR references from professionally graded HDR10 content (48 videos, 192 frames), LIVE Paired Comparison HDR vs. SDR Database. LumaGuide achieves a lower distance (0.139) than vanilla Flux (0.250) and X2HDR (0.179), indicating closer agreement with real HDR luminance statistics. We believe this evaluation more directly addresses the reviewer's concern about distribution-level HDR fidelity, while complementing our existing perceptual and subjective assessments.
Regarding the subjective study setup, the study was conducted indoors using the built-in Liquid Retina XDR HDR display of an Apple MacBook Pro, with nominal HDR brightness specifications of 1000 nits sustained full-screen and 1600 nits peak. All stimuli were encoded as 10-bit AVIF using BT.2020 primaries, the ST.2084 PQ transfer function, and the BT.2020 non-constant-luminance matrix (CICP 9/16/9). HDR metadata was verified for each stimulus. Images were presented through Chrome in full-screen mode using a randomized 2×2 ranking interface, with a 600 ms neutral-gray screen between trials and an optional rest after the 20th trial.
In the revised manuscript, we have expanded the Appendix A.8 to specify the HDR display, stimulus color encoding and metadata, and viewing conditions.
Response to W5: Temporal Luminance Consistency and Video Evaluation
We thank the reviewer for the suggestions regarding video evaluation and temporal luminance consistency. Playable HDR videos have been included in the supplementary material.
Our original evaluation in Appendix A.9 includes a controlled ablation using the same CogVideoX backbone. The results show that TLC reduces highlight-region temporal luminance variance from 0.025 to 0.016 relative to W1 guidance alone. Since this evaluation measures luminance variations at fixed image coordinates, it does not explicitly distinguish flickering from changes induced by object or camera motion. We therefore extend the evaluation to motion-compensated temporal luminance measurements to further examine TLC's effectiveness under motion. Specifically, we evaluate optical-flow-aligned first- and second-order luminance differences across the same generated videos, considering both threshold-based highlight regions and the brightest 2% of pixels. W1+TLC consistently achieves lower motion-compensated flicker errors than W1 guidance alone across all four metrics, with 3–7% reductions in geometric-mean error ratios. To examine whether TLC suppresses legitimate temporal changes, we additionally assess the preservation of motion and luminance dynamics relative to W1 guidance alone. W1+TLC also achieves a motion-preservation score of 0.99 relative to W1 guidance, suggesting that the reduction in temporal luminance fluctuations is accompanied by minimal changes to the generated motion. Together, these results indicate that TLC can further reduce temporal luminance fluctuations beyond fixed-coordinate evaluation while largely preserving the generated motion and luminance evolution.
For the suggested SDR-to-HDR video conversion baseline, we agree that combining the same pretrained SDR video generator with a separate HDR conversion method is a relevant alternative. However, this represents a two-stage generation-and-conversion pipeline, whereas LumaGuide integrates luminance control directly into diffusion sampling without a separate conversion model. Such a comparison would assess the relative effectiveness of two different HDR synthesis strategies, rather than specifically isolating the contribution of sampling-time guidance. Our current backbone-controlled evaluation therefore focuses on assessing the contributions of sampling-time guidance and TLC, while avoiding the additional modeling choices introduced by a separate HDR conversion stage.
In the revised manuscript, we have clarified the scope of fixed-coordinate temporal regularization in Section 3.4.
Response to W6: Limitations in the Main Text
We thank the reviewer for this suggestion.
In the revised manuscript, we have added a concise discussion of limitations to the Conclusion, with detailed analyses and visual examples retained in Appendix A.11.
Response to W7: Downstream Applications
We thank the reviewer for suggesting IBL as a potential downstream application. Our work primarily focuses on training-free HDR luminance distribution control, which we evaluate through luminance-distribution metrics, multi-exposure comparisons, and subjective assessments. While IBL is a promising application, it typically requires spatially accurate HDR environment maps, whereas our current work focuses on general-scene HDR image generation rather than environment-map synthesis. We consider exploring such downstream applications an interesting direction for future research.
Response to Related Work Suggestions
We thank the reviewer for suggesting these relevant studies. In the revised manuscript, we have expanded the Related Work section to discuss the suggested papers.
We thank the reviewer for recognizing the strengths of our approach and for the detailed, constructive feedback. We address the reviewer's comments below. All changes in the revised manuscript are highlighted in blue for ease of reference.
Response to W1: Highlight/Shadow Analysis and Post-hoc Histogram Matching
We thank the reviewer for suggesting targeted highlight/shadow analysis and a post-hoc histogram-matching baseline.
To compare against post-hoc histogram matching, we introduce a nonlinear CDF-based baseline using the same target histograms, prompts, and random seeds as LumaGuide. Although post-hoc matching achieves better histogram alignment (uW1: 0.33 vs. 0.58), LumaGuide achieves higher Q-quality (0.568 vs. 0.521) and Q-alignment (0.814 vs. 0.797). These results suggest that more accurate histogram matching alone does not necessarily translate into higher measured perceptual quality, highlighting the benefit of incorporating luminance guidance during sampling rather than applying post-hoc adjustments.
We further examine local highlight/shadow structure through a targeted region-level analysis using shared spatial masks derived from the vanilla outputs. Compared with post-hoc matching, LumaGuide achieves higher highlight local contrast (0.144 vs. 0.059), with improvements on 93% of the evaluated examples under this metric. It also achieves higher highlight gradient magnitude (0.027 vs. 0.017) and reduces extreme highlight clipping relative to vanilla generation (11.0% to 1.0%). In shadow regions, LumaGuide achieves higher local contrast (0.111) than both vanilla generation (0.039) and post-hoc matching (0.057). These findings provide targeted evidence of stronger local luminance variations beyond global histogram alignment. We additionally include multi-exposure comparisons at EV−4, EV0, and EV+4 to visualize differences in local luminance rendering.
In the revised manuscript, we have added the post-hoc histogram-matching baseline and its quantitative comparison in Section 4.3, with additional region-level analysis and multi-exposure visualizations in the Appendix A.4.
Response to W2: HDR Signal Representation and Luminance Calibration
We thank the reviewer for highlighting the need to clarify HDR signal representation and luminance calibration. Explicitly specifying the conversion between decoder outputs, PQ-coded signals, and absolute luminance is important for reproducibility.
Regarding the conversion pipeline, we first normalize the VAE decoder outputs from [−1,1] to [0,1] and interpret them directly as PQ-coded RGB values. We then compute a PQ-domain luma proxy using the BT.2020 coefficients:
YPQ′=0.2627RPQ′+0.6780GPQ′+0.0593BPQ′.
This proxy is used to construct the differentiable histogram for Wasserstein-1 guidance. Our implementation does not first convert the decoder outputs to linear-light RGB or apply an additional PQ transfer function. We have therefore corrected the original notation PQ(Lum(x)), which did not accurately describe the implemented pipeline.
For luminance evaluation, vanilla Flux and LumaGuide follow the same PQ interpretation and evaluation conventions. The PQ-coded RGB channels are converted into linear-light values using the ST.2084 EOTF, from which luminance statistics are computed in nits. No additional luminance normalization is applied to the generated LumaGuide outputs. This procedure defines an absolute-luminance interpretation under the PQ convention, rather than an independent physical calibration of the pretrained decoder.
In the revised manuscript, we have clarified the signal definitions and conversion pipeline in Section 3.1, Algorithm 1, and the evaluation protocol, distinguishing the PQ-domain guidance proxy from linear-light luminance measurements.