- Rating
- 1(−1)
- Confidence
- 2
- Informativeness
- 1(−1)
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
ConTraPosE extends contrast maximization to event-based 6DoF object tracking using a known CAD model and initial pose. It evaluates candidate motions through geometry-induced event warping and normalized contrast, with adaptive temporal windows and optional depth correction. Experiments on Event6D and SPADES evaluate tracking accuracy, robustness, and computational cost.
Critical strengths
- The method provides a clear motion-consistency formulation for event-based object tracking, reducing dependence on appearance matching.
- Experiments on two datasets demonstrate strong tracking performance, complemented by robustness evaluations under varied conditions.
Critical weaknesses
- Motion compensation and IWE contrast maximization without additional appearance information or explicit event correspondences are central to [1]. Meanwhile, [2] already use known 3D models and rigid-motion projection with motion interpolation for event-based 6DoF object tracking, although their objective is brightness-increment alignment. ConTraPosE appears to combine geometry-based motion construction with the established CMax framework, but does not sufficiently establish the methodological advance of its specific design beyond this combination. This leaves the methodological contribution closer to a task-specific extension than a substantial new formulation.
[1] Gallego G, Rebecq H, Scaramuzza D. A unifying contrast maximization framework for event cameras, with applications to motion, depth, and optical flow estimation[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2018: 3867-3876. [2] Kang Y, Caron G, Ishikawa R, et al. Direct 3D model-based object tracking with event camera by motion interpolation[C]//2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024: 2645-2651.
-
The experiments demonstrate the effectiveness of the complete tracker, but do not isolate the contribution of the proposed core formulation. Comparisons with EDOPT and ETAP+PnP involve different tracking mechanisms, while the reported ablation primarily evaluates adaptive temporal windows. Controlled comparisons with CAD-based CMax variants under matched optimization and window settings are needed to establish the specific benefit of the proposed motion-field construction and normalized objective.
-
The layout is overly compressed, with insufficient spacing around figures and tables. Some visual elements in Figure 2 overlap, while the crowded arrangement of figures, tables, and surrounding text reduces readability.
Questions for authors
- What specific methodological advance does the proposed formulation provide beyond combining the CMax framework in [1] with model-based rigid-motion projection and interpolation as used in [2]?
- Are there existing CMax-based methods that could provide a closer comparison in this tracking setting? If not, could the authors provide targeted ablations of motion-field fusion, support weighting, and contrast normalization, while keeping the motion parameterization, optimizer, and temporal-window policy fixed?
6 comments
Controlled Ablation Study (W2/Q2)
Controlled comparisons (W2/Q2)
We construct a direct CAD-based adaptation of conventional CMax and progressively introduce the proposed components, keeping the temporal window and optimization settings fixed (this study is added in the revision, Sec. 5.4, Table 4):
- CAD-CMax baseline: Computes constant optical flow from object velocity and CAD depth at the initial pose; we use the conventional contrast objective, IWE variance. Only events within the initial object silhouette are considered for warping, excluding events triggered in the new object location.
- + Motion interpolation (fixed visibility): Uses interpolated poses while retaining reference-visible CAD points, without updating surface visibility.
- + Motion interpolation (updated visibility): Renders motion fields at intermediate poses with updated visibility, including newly visible surfaces.
- + Geometric support and normalized contrast: Weights events using candidate-dependent geometric support and normalizes the contrast by the accumulated event weight.
| Configuration | ADD ↑ | ADD-S ↑ |
|---|---|---|
| CAD-CMax baseline | 13.76 | 23.96 |
| + Interpolation (fixed visibility) | 13.01 | 23.52 |
| + Interpolation (updated visibility) | 14.31 | 24.24 |
| + Geometric support & normalized contrast | 23.76 | 36.97 |
The results show that interpolation alone provides no consistent improvement over the CAD-CMax baseline. Updating visibility yields only a modest gain, whereas introducing geometric support and normalized contrast improves ADD by 9.45 and ADD-S by 12.73 points over the preceding configuration. These results demonstrate that the improvement cannot be attributed simply to combining CMax with motion interpolation. Instead, the largest gains arise from accounting for trajectory-dependent event support within the contrast objective, supporting the importance of the proposed formulation. Additional ablations isolate the effects of support and normalization (Appendix A.3.2, Fig. 3), while motion-field experiments compare fused and iterative warping (Appendix A.3.1, Tables 7–8).
Presentation (W3)
We agree that the layout was compressed. We corrected overlapping elements in Figure 2 and improved spacing around figures, tables, and captions in the revised manuscript.
Thank you for the clarification. Your response helps distinguish the implementation details from the existing CMax and BIAM frameworks. However, I still view the main contributions—visibility updates during motion interpolation and candidate-dependent differentiable event support—as incremental extensions of existing mechanisms rather than a substantial methodological advance. In particular, the core ingredients of motion interpolation, object-region event selection, and normalized contrast are already established. Therefore, my concern regarding the limited methodological novelty remains.
Methodological Novelty: Motion Fields, Event Support, and Adaptive Windows (W1/Q1)
Positioning and methodological novelty (W1/Q1)
We thank the reviewer and agree that we should distinguish our methodological contributions more clearly from existing methods. CMax [1], CAD-based projection, and motion interpolation [2] are established, and we do not claim novelty in these components individually. Our contribution lies in adapting the CMax objective to CAD-based 6DoF object tracking, where both the image motion field and the spatial support of object events depend on the candidate pose trajectory. Simply combining conventional CMax with CAD-induced object motion, even with motion interpolation, does not fully address these challenges. Specifically, we identify and address two methodological challenges:
1. Accurate motion-field representation. Existing CMax formulations commonly approximate optical flow as a constant over short temporal windows. For object tracking, longer windows may be needed to accumulate sufficient observable motion, particularly for small or distant objects. However, the projected motion field and visible surfaces can change substantially within these windows. While BIAM [2] uses motion interpolation, its motion representation relies on fixed reference-visible geometry without updating visibility. We instead render CAD-induced motion at intermediate poses, updating visible surfaces at each step and combining the resulting motion fields.
2. Pose-dependent event support and contrast normalization. Conventional CMax typically evaluates motion hypotheses using a fixed set of events. In object tracking, however, the object occupies only part of the ROI, and its projected region changes with the unknown motion. Each candidate pose trajectory determines both how events are warped and which events are likely to belong to the object. However, the contrast objective may favor incorrect poses that shift the projected object region toward areas of high background event density, increasing the contrast score by including more events rather than correctly aligning object events. We address this with differentiable geometric support, which weights events according to the projected object region, and we propose a normalized contrast objective, which reduces the influence of variations in accumulated event weight and encourages better event alignment. Together, these components extend CMax beyond motion interpolation by incorporating candidate-dependent object visibility and event support directly into the optimization objective.
In summary, applying CMax to 6DoF object tracking introduces a different optimization problem, in which event selection and motion estimation are coupled through the unknown pose trajectory. Addressing this challenge requires a new formulation that accounts for both event alignment and trajectory-dependent event support. To demonstrate the contribution of our formulation, we first implement a baseline that directly applies conventional CMax to CAD-based object tracking, then progressively introduce our proposed components. The corresponding controlled ablations are presented in the following response.
[1] Gallego, G., Rebecq, H., & Scaramuzza, D. (2018). A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation. CVPR. [2] Kang et al., Direct 3D Model-Based Object Tracking with Event Camera by Motion Interpolation. ICRA, pp. 2645–2651, 2024.