- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes a system to time synchronise heterogenous sensors (e.g. camera with IMU or LIDAR with IMU) matching motion that is being observed by different sensors at different rates and with different level of reliability.
The proposed system injects controlled timestamp shifts and uses that as supervision for learning how to time-synchronise the different sensor modalities.
Critical strengths
- Interesting idea of using controlled time shifts as supervision
- Significant performance improvements shown compared to baselines
Critical weaknesses
Related work is limited and needs to be expanded...
- Closed form estimator approaches, e.g. Lightweight Standalone Temporal Calibration for Visual-Inertial Odometry on Resource-Constrained Embedded Systems: A Closed-Form Estimator with Statistical Hardening. Several other papers in this category
- Implicit time synchronisation via selective sensor fusion, instead of treating calibration as a separate step: e.g. "Learning Selective Sensor Fusion for State Estimation". Many others in this category
- Reinforcement based approaches e.g. L2Calib: SE(3)-Manifold Reinforcement Learning for Robust Extrinsic Calibration with Degenerate Motion Resilience
The paper is hard to read. The method in Section 3 and the various subsections are very hard to follow in the main architecture diagram of Figure 1. For example the loss function shown in the figure and its components are hard to track in the text, and the same applies for the modules in the architecture diagram and subsections of section 3.
Questions for authors
Is the idea of injecting controlled timestamp shifts applicable to many different architectures or specific to ZeroSync? Here you present it as a specific architecture, but could this be a high level approach that can be adapted to improve several state of the art methods?
What are the reasons that correlation does not work in some cases? It would be good to provide an illustrative example in the introduction or method sections to demonstrate the problem more clearly and then show how training with the proposed controlled timestamp shifts enables the network to learn a better time alignment.
Are there any specific challenging conditions that make the time alignment particularly difficult for existing methods ? If so, what are these conditions - and why does your approach manage to handle them better?
Official Comment by Reviewer oiqj
I appreciate the responses made by the authors, which solved most my concerns. However, I still have one concern about the seed selection, the results in Appendix J is different to Appendix F. What make this difference