- Rating
- 3
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies training-isolated heterogeneous cooperative perception: how systems independently trained on private domains can collaborate at their first encounter without pair-specific optimization. IsoComm enables zero-shot cooperation through Protocol-Basis Diversification (PBD) and Ownership-Preserving Attention (OPA), with lightweight communication interface calibration (CAC) for persistent partnerships.
Critical strengths
- The problem is practically relevant. It focuses on first-encounter cooperation between independently developed systems, reflecting the needs of cross-vendor deployment.
- The deployment regimes are clearly distinguished. The paper separately considers ad-hoc zero-shot cooperation and commissioning for persistent partnerships.
- The experiments demonstrate consistent cooperative gains. All three unseen senders improve receiver performance, with additional validation across different receivers and a camera-based system.
Critical weaknesses
My main concerns are the assumptions needed to connect the systems, the strength of the zero-shot comparisons, and the scope of the generalization evidence.
-
The claimed openness rests on substantial interface assumptions. Although the formulation permits different fusion designs, every evaluated system uses the same V2X-ViT structure, communication channel count, and attention projection specifications. Collaborators must therefore agree on a structural interface before deployment. It is unclear how an existing system built around a different architecture could participate. The core augmentation also operates on BEV features and, as formulated, does not accommodate systems without such representations. These requirements materially limit the motivation for a fully open setting. These issues substantially affect whether the motivation is justified and should be addressed.
-
The zero-shot evaluation needs stronger alternatives. Ego-only and Direct fusion are useful reference points, but directly connecting incompatible feature interfaces is a weak test of the proposed solution. Its failure establishes the problem rather than demonstrating that IsoComm is the best way to address it. Comparisons with simple feature normalization, Direct fusion using the same message safeguard, and late fusion of independently predicted detections would make the evidence more convincing.
-
The deployment tests cover only one direction of domain shift. The systems are trained on OPV2V and V2XREAL, yet all main results and additional receiver experiments are evaluated on OPV2V. The receiver consequently operates in its own training domain throughout. Reverse pairings evaluated on V2XREAL, together with a deployment domain unseen by both systems, would provide a stronger test of the claimed first-encounter cooperation capability.
Questions for authors
My questions are the same as the concerns raised above.
4 comments
W3. Reverse-direction domain shift and deployment generalization
We thank the reviewer for highlighting the importance of evaluating domain shifts in both directions, and agree that reverse-direction evaluation would provide valuable additional evidence of generalization. Our current experiments fix an OPV2V-trained receiver and evaluate three independently trained V2XREAL senders, demonstrating consistent zero-shot cooperative gains across unseen heterogeneous sender architectures (Table 1). Appendix A.4 (Table 6) further evaluates different receiver architectures, including a camera-based system. These results support the effectiveness of first-encounter cooperation across the evaluated independently trained systems, although they do not establish symmetric generalization across domain-shift directions.
We recognize reverse-direction evaluation as an important extension of the current experimental evidence. In particular, evaluating V2XREAL-trained receivers with independently trained OPV2V senders would directly test whether the observed cooperative gains extend to the opposite domain-shift direction. A rigorous evaluation requires additional receiver training and consistent ego-only and Direct fusion baselines, which could not be completed within the rebuttal period. We will include the reverse-direction evaluation in the revised manuscript's Appendix, together with the corresponding baselines and evaluation protocol. We will also clarify the scope of the current experiments and the remaining deployment-domain generalization boundary in the Limitations section.
While this method suffers from some overclaims—for instance, it is incompatible with non-BEV-based systems yet is claimed to be fully generalizable—this seriously undermines the soundness of the motivation. I will not lower my score on this condition if the authors soften such statements throughout the paper.
We sincerely thank the reviewer for the constructive clarification and for the opportunity to strengthen the precision of our claims.
We have revised the manuscript throughout to explicitly acknowledge the structural-interface assumptions and align our generalization claims with the scope of the experimental evidence. Specifically, we have clarified the compatible structural communication interface in the Abstract, situated our research problem within BEV-based cooperative perception in the Introduction, distinguished structural compatibility from learned representation alignment in the Contributions, §2.2, and §3.1, and refined the Conclusion accordingly. We have also added §6, Limitations and Future Work, explicitly discussing non-BEV representations, alternative fusion architectures, and broader generalization as future research directions. All revisions are highlighted in blue in the revised manuscript for ease of reference.
We would also like to clarify that our evaluation of BEV-based systems does not establish fundamental incompatibility with non-BEV systems; rather, such interoperability remains unverified. BEV-based communication is a well-established setting in heterogeneous collaborative perception, as adopted by representative frameworks including HEAL [1], STAMP [2], GT-Space [3], and GenComm [4]. Within this setting, heterogeneous systems may differ in sensing modalities and perception encoders while sharing a compatible spatial communication interface. Our experiments accordingly evaluate independently trained PointPillar, SECOND, PIXOR, and camera-based LSS–ResNet101 systems.
We fully agree that extending IsoComm to non-BEV representations and more diverse fusion architectures would further strengthen its generality. Our revised manuscript now consistently distinguishes the demonstrated zero-shot cooperation across independently trained systems under compatible structural interfaces from unrestricted architectural interoperability. This clarification preserves our central contribution—effective first-encounter cooperation without shared training or pair-specific optimization—while avoiding claims beyond the experimental evidence.
We appreciate the reviewer's guidance and hope the completed revisions satisfactorily address this concern.
References
[1] Lu et al., An Extensible Framework for Open Heterogeneous Collaborative Perception, ICLR 2024.
[2] Gao et al., STAMP: Scalable Task- and Model-agnostic Collaborative Perception, ICLR 2025.
[3] Wang et al., GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature Space, ICLR 2026.
[4] Zhou et al., Pragmatic Heterogeneous Collaborative Perception via Generative Communication Mechanism, NeurIPS 2025.
We sincerely thank the reviewer for recognizing the practical relevance of first-encounter cooperation in cross-vendor deployment, the clear distinction between ad-hoc zero-shot cooperation and persistent-partnership commissioning, and the consistent cooperative gains across unseen senders and diverse receiver architectures, including a camera-based system. We appreciate the constructive feedback and address the concerns below with additional experimental evidence and clarifications.
W1. Structural Interface Assumptions and Applicability
We agree that the current implementation requires a compatible structural interface, which limits its applicability to systems with incompatible communication architectures. As specified in Appendix A.1.2 and A.2.3, the evaluated systems share BEV feature dimensions and V2X-ViT-based attention specifications. Consequently, while our experiments include different perception encoders and sensing modalities (Table 1 and Appendix Table 6), they do not establish compatibility with arbitrary fusion architectures or systems without BEV representations. We acknowledge these limitations of the current implementation.
The need for a structural interface limits the range of compatible systems, but does not negate the motivation for studying first-encounter cooperation between independently developed systems. Our reference to a "more open setting" concerns systems developed independently without shared training data, jointly optimized components, or pre-established learned representations, rather than unrestricted interoperability without structural prerequisites. Even with a compatible interface, independently developed systems do not automatically achieve effective first-encounter cooperation, as illustrated by the pair-dependent Direct fusion results in Table 1. We believe removing the structural-interface requirement is an important and valuable direction for future research toward more general heterogeneous cooperation. We will explicitly discuss this limitation and future direction in a new Limitations section.
W2. Stronger Zero-Shot Comparisons
We thank the reviewer for suggesting stronger zero-shot alternatives and have conducted additional comparisons with feature normalization and safeguard-matched Direct fusion. Specifically, we evaluate Direct fusion with mean–variance normalization (MVNorm) and Direct fusion with the same norm-clipping safeguard used in zero-shot IsoComm. Neither baseline requires pair-specific training or adaptation, allowing us to directly examine whether these simpler mechanisms can address the incompatibility between independently trained feature representations.
Direct fusion, Direct + MVNorm, and the reported IsoComm variant use clipping OFF; Direct + Clipping uses the original safeguard with ρ = 0.05.
These controlled comparisons demonstrate that IsoComm's effectiveness cannot be explained by simple normalization or norm clipping alone. MVNorm provides only limited improvements over Direct fusion, particularly on the challenging B1 pairing (58.34 vs. 57.66 AP50). Norm clipping substantially improves Direct fusion on B1 (85.44 AP50), confirming that the safeguard can mitigate harmful sender contributions. However, IsoComm without clipping still outperforms Direct fusion with clipping by 3.10 AP50 and 5.76 AP70 on B1, and achieves the highest AP50 and AP70 across all three unseen senders. Importantly, IsoComm maintains a cross-sender AP50 range of only 0.25 points without clipping, demonstrating that its consistent cooperative gains are not dependent on the safeguard. These results provide stronger evidence for the effectiveness of IsoComm beyond directly connecting incompatible feature interfaces.
Regarding Late Fusion, the independently trained OPV2V and V2XREAL detectors have different category definitions and prediction-score distributions, requiring additional cross-domain output harmonization for decision-level fusion. Moreover, Late Fusion combines final detection outputs rather than addressing the interoperability of intermediate representations, which is the central challenge studied in this work. We therefore prioritize comparisons that directly test intermediate-feature compatibility under the same zero-shot setting. We recognize Late Fusion as a complementary decision-level reference, but it addresses a different communication paradigm.
We will include the additional normalization and safeguard comparisons, together with their implementation details, in the revised Appendix.