- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper is studying binding and the extent to which it is a property of the representation. The first result that the authors show is a "binding limit" that show that conditioned on the roles of the items and the observation the representation cannot reduce the correlation between fillers without losing information. The second result shows that an "information preserving relabeling" can appear to bind without losing information. The results of the paper are evaluated experimentally.
Critical strengths
I find the problem interesting in general and the formulation could lead to an interesting modeling of the problem.
Critical weaknesses
The paper is hard to follow, e.g. it uses notation that wasn't defined before. As far as I can tell the proofs are rather simple and the resuolts not particularly surprising. Thus, I assume that the most significant part of the paper is the modeling of the problem. Unfortunately, not enough attention is given to explain why this is a good formalization of the problem. In general it seemed to me that there was a disconnect between what the paper claims to show in the title, abstract and intro and what the theoretical result is. The model does not seem to me to faithfully capture the scenario discussed in the intro: I don't quite understand why the color of a the car and the color of an apple become correlated once someone sees the observation (I assume that is supposed to mean the image).
I believe that the paper would benefit a lot from a more in depth discussion of the assumptions and modeling choices and why this captures the problem of interest. If these assumptions are standard a reference would be useful (I didn't see any).
Questions for authors
What is the intuition behind the correlation of fillers conditioned on the observation?
It is especially unclear to me in the car and apple example. Clarifying that would help me understand the modeling of the problem much better.
Thank you for the careful responses, with the code availability, the audit’s model-access, and annotation requirements, address several of my problems. The explanation of de-occlusion, serving as a controlled test of the theory rather than a method, addressed my concerns. The responses clarified the methodology and experimental intent, but do not fully resolve my concerns about the interpretation and practical relevance of the results. I will therefore maintain my original score of 2 (Weak Reject).