- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates whether memorability guidance using one predictor improves scores from other predictors. It applies gradient-based guidance to latent diffusion models for image generation and editing. Experiments show improvements across multiple predictors, but also reveal limitations in image quality, text alignment, and consistency.
Critical strengths
-
The paper investigates whether memorability improvements guided by one predictor can generalize to other predictors. This is an important question, as optimizing a single predictor does not necessarily indicate an actual improvement in image memorability.
-
The experiments include multiple memorability predictors, datasets, and guidance settings. The analysis of both average improvements and individual-image agreement provides useful insights into the consistency of memorability guidance.
-
The matched reconstruction, reverse guidance, and random perturbation controls help distinguish the effects of memorability guidance from changes introduced by image reconstruction or generic perturbations.
Critical weaknesses
-
The paper relies entirely on pretrained memorability predictors without conducting human recognition experiments on the generated or edited images. Improvements in predicted memorability do not necessarily translate into actual improvements in human memory.
-
All 4 memorability predictors are trained on the same LaMem dataset, which may introduce shared biases. Therefore, improvements across held-out predictors do not necessarily demonstrate generalization beyond their shared training distribution.
-
The qualitative results show limited perceptible changes between the unguided and guided images, particularly in Figure 3, where neither semantic nor pixel-level differences are clearly noticeable. Despite improvements across multiple memorability predictors, it remains unclear whether these subtle changes have meaningful effects on human memory or offer practical value.
-
The SDXL experiments show that memorability predictor scores can increase even when the generated images contain obvious visual artifacts and structural distortions. This raises concerns about the reliability of predictor-based optimization, as higher memorability scores do not necessarily correspond to perceptually meaningful or visually plausible improvements.
-
The proposed method mainly applies existing universal guidance techniques with pretrained memorability predictors, without introducing substantial methodological innovations. The contribution is primarily an empirical evaluation of existing approaches rather than a new memorability manipulation method.
-
Most experiments are conducted using Stable Diffusion 1.4, while the SDXL evaluation includes only 5 prompts. It remains unclear whether the findings generalize to more recent diffusion or flow-matching models.
Questions for authors
-
Given that all memorability predictors are trained on LaMem, how can the authors determine whether improvements across held-out predictors reflect meaningful memorability changes rather than shared model biases?
-
The paper does not include human recognition experiments on the generated or edited images. Is there any behavioral evidence supporting the claim that higher predicted memorability leads to improved human memory performance?
-
In Figure 3, the guided images show very limited perceptible changes despite significant improvements in predicted memorability. What visual or semantic properties are actually modified by the guidance, and how might these changes affect human memory?
-
The SDXL experiments show increased memorability scores even when the generated images contain obvious visual artifacts. How do the authors distinguish genuine memorability improvements from the exploitation of predictor sensitivities?
-
Given that best-of-four sampling achieves comparable results with lower computational cost and better text-image alignment, what practical advantages does gradient-based memorability guidance offer?