- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper argues that having a concept direction summarized by a single vector is limiting. They introduce Archetypes of a Concept (AoC) as a post-hoc method that decomposes concept-positive features to create a new query. The procedure starts with training a linear probe, fitting sample weights and training-sample coefficients to positive training features, ranking archetypes and retaining from a selected dictionary, infer the coefficients over the dictionary from the query, and then compare queries over their coefficient vectors. The authors argue that this approach improves on prior work by having more utility and semantic meaning.
Critical strengths
Thorough description of AoC procedure with mathematical results to motivate the steps. Thorough description of prior work with explanations on how AoC differs from these methods.
Critical weaknesses
- Paper is difficult to understand. There is no clear motivating impact, with introduction sparse on citations of why having this decomposition by training set is so important.
- Paper relies on concrete training set (i.e. is not a theoretical contribution). However, there are no experimental results on real datasets on the results. There are also no benchmark results against other methods. While there are some results in the supplement, I do not believe the reader should have to shuffle through the supplement to find support for the primary claim of the text.
- There is a discussion on AoC outputs and their semantic value without any example or explanation of a typical AoC output.
Without a clear motivation of the problem, results on data, or results on benchmarks, I can not recommend accepting this paper.
Questions for authors
There seems to be a lot of reliance on the training data for AoC. How do you expect AoC to act on distribution shifts? Is access to the full set required? Did you try sub sampling the training set and comparing results (i.e. robustness testing)?
Can you provide a running example on where AoC would be used, the outputs of AoC, and what impact that would have?
Why did you pick CRAFT as the only comparator in the Appendix compared to the other benchmarks (ACE, TCAV, etc) in your related work?
What set of models would this work over? CLIP models only?