- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces CoDER, a representation learning framework that combines representations through two distinct representation learning pathways, i.e., a statistical-invariance pathway and a context-aware pathway. The final predictions are later combined through evidence fusion. Experiments across five domain generalization benchmarks show that CoDER has better performance for domain generalization.
Critical strengths
- The overall motivation and the approach are reasonable. The proposed approach is motivated by the limitation of using only the invariance representation, which may not capture all the useful predictive information. CoDER addresses this problem by combining invariant and contextual representations.
- The experiments are extensive and demonstrate the effectiveness of the proposed approach. The ablation and analysis are thorough for the two branches.
- The paper is overall well-written and easy to follow.
Critical weaknesses
- The novelty and technical contribution of the paper seem somewhat limited. While the experiments show the effectiveness of CoDER, the framework consists mostly of available components. The paper would benefit from a clearer explanation of the technical contribution of the paper compared to prior works.
- The motivation that statistical alignment can be limiting makes sense. However, Figure 1 is mostly conceptual, and the experiments do not provide enough insight into when and why statistical alignment can be insufficient. The paper would benefit from a more concrete illustration of how using statistical alignment alone can be insufficient and how the proposed contextual representations address this limitation.
- While the ablations support the effectiveness of combining two different pathways, it is not clear what predictive information each pathway encodes and whether they are complementary. The paper should incorporate some analysis demonstrating how these are complementary beyond performance improvement and what information they capture differently.
- The citation format is not correct in many cases, using narrative citations instead of citations in parentheses.
Questions for authors
Please see weaknesses.