- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces CANDLE and CANVAS, with CANDLE as an evaluation framework for a model's creativity under a relative novelty score against the model's own default generations. It works by comparing a weighted average of semantic deviation and lexical deviation against the default generation (the model without any modifications). CANVAS is a steering framework applied to the model's weights to steer the behavior of outputting more creative generations. It works by generating responses from the model and judging those according to some rubrics on validity and novelty, and then the authors used the Creativity Attribution Score (an activation-gradient product value that indicates which neurons can be adjusted to make the model more creative) to apply a steering scaler to the FFN down projection matrix of top k neurons for steering the model's creativity. The paper also introduces two safeguard mechanisms to prevent model from collapsing. The paper tested three families of models on their methods and compared against a broad range of ways of steering the model's creativity, and shows their method is usually the best under their evaluation framework. Lastly, they show a large human-AI alignment on the creativity judgement of the final results.
Critical strengths
The strength is that the paper proposes a steering method that is easy to use, and it provides quick model updates without substantial training or inference time, while preserving the model's general capabilities quite well. This is important since it is efficient and easy to apply and has some possible practical uses if one wants to have a more creative model.
Critical weaknesses
The evaluation is a bit constrained, and a more holistic evaluation of creativity (under different criteria or task types) might be better to demonstrate the effectiveness of their method. For instance, try creativity in different domains such as math. From my understanding. CANDLE measures more of the relative gains of the model to itself, which may omit dimensions of creativity in general. In addition, CANVAS depends on GPT-4o for quality filtering and creative-span annotation, and thus the selected neurons may reflect the annotators' preferences. If the authors can show that with other creativity-related metrics, CANVAS can still perform well, I will consider to raise my score.
Questions for authors
- Can authors show that with other creativity-related metrics, CANVAS can still perform well across different kinds of creativity-related tasks that are relatively more out of domain compared to the tasks being trained on? For instance, can this method make the model produce more creative math solutions or poems, while maintaining correctness or format constraints?
- Can the author show if the alpha score lower than 1 means less creative outputs? I wonder if there is an interpretable understanding of the alpha score and if it is well calibrated as well. This is important since if the method is applied to general cases, we want to ensure the alpha is well-calibrated under different creativity requirements.