- Rating
- 3(+2)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
With this paper, the authors propose another inference-time steering method called LatentCompass for text-to-image generation. It differentiates between two types of attributes: "descriptive" attributes as properties that can be easily expressed in language, and "evaluative" attributes as properties that can only be evaluated after the completed image generation by an external judge. They make the argument that prior work that focuses on text-based steering struggles with controlling such evaluative properties. Therefore, they take an exemplar-based approach, i.e. they take a set of images for guidance, not just pieces of a prompt, to define the subspace the the steering-based control at inference-time. The paper evaluates LatentCompass on the suppression of explicit nudity content (descriptive) on established benchmarks, on debiasing gender (descriptive) and skin color (descriptive), on fooling synthetic-image detectors (evaluative), and on improving image aesthetic scores (evaluative).
Critical strengths
- Broad and diverse demonstration of the use of LatentCompass.
Critical weaknesses
- Substantial chunk of conceptually extremely similar prior work is entirely neglected as baselines and in the related work section discussion. The "conventional" steering approaches. I want to name a few examples here: CASteer (Gaintseva et al., ICLR 2026), SafeRoPE (Yang et al., CVPR 2026), and GrOCE (Han et al., CVPR 2026). Also careful prompt adjustments ("A female doctor with brown skin" and not just "A doctor"), negative prompting (steering away from "male"), or compositional prompting (using additional positive guidance vectors) is not evaluated against, despite them being very clear and simpler baselines.
- The framing of the paper is a bit convoluted: two types of attributes to control (descriptive and evaluative) of which only one of them (the evaluative attributes) really counts as a selling point for using an exemplar-based approach, because the comparison on descriptive attribute control (suppression of nudity or debiasing) is not extensive enough itself due to missing baselines, while positioning as a full inference-time control over "evaluative attributes" would require a broader set of baselines itself as well. Currently, there is no baseline for debiasing and no baseline for steering towards more aesthethics. Both of them individually are interesting, but showing competitiveness for a method for both would probably better be done in to focused separate papers for more clarity and a deeper evaluation.
Questions for authors
Clarifications
- Why do you consider UCE and RECE as training-free? They clearly manipulate the weights of a model before inference happens, especially RECE even for multiple consecutive closed-form updates.
- What is the run-time overhead of LatentCompass? It is said to be closed-form but the preparation/generation of the exemplars needs to be taken into account.
Future Work
- Can you compare against more recent, applicable baseline beyond SAFREE? Without such a comparison, the current claim in the short related work section on related concept-erasure methods that steer away from toxic subspace do "struggle with safeguarding against subversive harmful prompts" is unsubstantiated.
- The main results used throughout the main paper are on SD v1.4, which is considered fairly outdated regarding its architecture and training paradigm.