- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the issue of coexisting attributes in CZSL. The authors organize state attributes into different semantic slots and introduce slot-specific supervision to improve the reusability of attribute representations. Experiments on three benchmarks demonstrate the effectiveness of the proposed method. However, the main paper lacks more fine-grained evaluation metrics. In addition, the tables contain considerable unused space, making the overall presentation less compact.
Critical strengths
1. Strong motivation and a novel perspective on attribute learning. The paper is well motivated and provides a fresh perspective on handling multiple coexisting attributes in CZSL. By reconsidering the supervision provided by a single composition label, the proposed method offers an interesting approach to learning reusable state representations.
2. Backbone-agnostic design. POSS has a modular and backbone-agnostic design, allowing it to be incorporated into different CZSL architectures.
Critical weaknesses
1. Similar supervision issues also exist at the object level. Similar issues also exist at the object level, as an image may contain multiple objects, and object categories may have hierarchical relationships. However, POSS only addresses state-level supervision without considering these cases. I wonder whether the same approach could also be applied to object-level supervision. If so, I would like to see some experimental results demonstrating its effectiveness.
2. Incomplete evaluation of state and object accuracy. Since the paper primarily focuses on state learning, state accuracy is an important metric. However, the paper lacks a comprehensive of state and object accuracy. In addition, the main results only report HM and AUC, while Seen and Unseen accuracy are presented in the appendix. This makes the results scattered across different tables. I suggest including Seen, Unseen, HM, AUC, as well as state and object accuracy in the main paper for a more comprehensive evaluation.
3. Insufficient discussion of existing multi-attribute CZSL methods. MAC: A Benchmark for Multiple Attributes Compositional Zero-Shot Learning (2024) has already explored multi-attribute learning in CZSL. The paper lacks a sufficient discussion of how POSS differs from MAC.
4. Lack of experiments on recent CZSL backbones. POSS is only integrated into CoOp, DFSP, and Troika, without experiments on more recent backbones such as ClusPro, Logic-Troika, or EVA. Although POSS already outperforms these methods, evaluating it on stronger backbones would better demonstrate its potential.
5. Insufficient discussion of prior object-conditioned state learning methods. Object-conditioned state learning has already been explored in prior works, such as Learning Conditional Attributes for Compositional Zero-Shot Learning (CVPR 2023) and Not Just Object, But State: Compositional Incremental Learning without Forgetting (NeurIPS 2024). However, these works are not cited in Section 4.2, where the authors introduce their object-conditioned state predictor. I would like to know how the proposed approach differs from these existing methods. The authors should also include the corresponding citations in the method section.
Questions for authors
Would independently running the same LLM with the same prompts produce different semantic slot structures? If so, how would these variations affect the downstream performance?
The four-point rating scale makes it difficult to reflect my current assessment accurately. My initial evaluation of this submission is around 2.5. If the authors can adequately address my concerns, I would be willing to raise my rating to 3 or higher.
Thanks for your response.
Thanks for the detailed responses, I have reviewed the responses and I think the responses have addressed my concerns.