- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors use nearest-centroid classificationAuthors derived the "intuition vector" as the difference of positive and negative support centroids, which they then used to retrieve the corresponding answer for query images using a nearest neighbour retrieval.
Critical strengths
The intuition vector of answer = query + (prototype out - prototype in) matches the queen = king + (woman - man) concept. Although concepts are well established, it's interesting to see it applies on ARC dataset.
illustrations and figures help with understanding.
Critical weaknesses
Theoretical grounding is weak. What is this "structure" in "systematic geometric organization", "plethora of evidence for emergent, informative structure across ...", "structure is coherent and functionally meaningful", etc?
The paper is difficult to understand with all the jargon. The analyses do not clearly explain why the method works or the assumptions it makes. Why are we computing prototype vectors and doing vector algrebra with it?
Only two models are investigated. CLIP trained vision encoders have been shown to give better results on Bongard tasks when using the same prototype vector methodology [1]. Is this "best published average" really the best?
The analysis on page 7 onwards, for the most part, is unclear, and should be in the appendix with only clear takeaways in the main text. The claim "representing a transformation and executing its consequence thus appear to be distinct capacities" is not sufficiently supported. Comparing classification against retrieval on pixel spaces (values) or embeddings does not support that. To do so, one should first define what "representing a transformation" and "executing a consequence" are. Only claim I can see this supporting is that dataset can't be solved using pixel similarity, supporting "beyond pixel similarity" claim, though, here, similarity is only one metric and doesn't prove solving by some measure/approach is not possible.
[1] Vompa et al., 2026, Beyond the Linear Separability Ceiling: Aligning Representations in VLMs
Questions for authors
Could you add a list with contributions so it's easier to evaluate the work done?