- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors introduce X3Calib, a single-frame LiDAR-camera (cross-modal) calibration method. By using a monocular depth estimation network, EasyCalib can then lift the 2D features to 3D to then find 3D geometric correspondences between the 2 modalities using a graph neural network (GNN). These geometric correspondences are then provided to a classic solver, such as PnP, to arrive at the final extrinsic parameters (rotation, translation), making X3Calib a hybrid cross-modal calibration method. The authors train and evaluate X3Calib on multiple datasets to evaluate against heterogeneous sensors and different extrinsics. The authors find that
Critical strengths
The authors correctly identifies that common datasets such as KITTI and NuScenes each only offer 1 extrinsic because of the established sensor suite used for data collection. Accordingly, the authors evaluate on multiple datasets to understand how X3Calib performs on multiple extrinsics.
Given that this calibration requires finding the spatial relationship (6 DoF relative transform) between two sensors, the idea to find the correspondences in 3D space is well motivated instead of between 2D and 3D features.
Critical weaknesses
There are newer cross-modal calibration baselines beyond LCCNet and CalibNet ([1][2][3]). Evaluating on some or all of these baselines would be helpful in understanding X3Calib's competitiveness. Furthermore, two of these newer baselines, BEVCalib and CalibBEV, follow a similar paradigm like X3Calib in performing the cross-modal calibration in the BEV grid.
The Identity baseline is unnecessary. If the extrinsic is not an identity transform, then the reported error is not meaningful because it's clearly wrong. The CalibNet baseline also reports translation and rotation error on roughly the same scale.
[1] Yuan, W., Li, J., Yue, J., Shah, D., Karydis, K., & Qiu, H. (2025). BEVCalib: LiDAR-camera calibration via geometry-guided bird’s-eye view representation. Proceedings of Machine Learning Research, 305, 4824–4836. https://proceedings.mlr.press/v305/yuan25a.html
[2] D’Addeo, F., Cipelli, L., Cardace, A., Ghelfi, E., Zinelli, A., & Bertozzi, M. (2026). CalibBEV: LiDAR-camera calibration via BEV alignment. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (pp. 4345–4354). https://doi.org/10.1109/WACV61042.2026.00423
[3] Ou, N., Chen, Z., Zhang, X., & Wang, J. (2026). Native-domain cross-attention for camera–LiDAR extrinsic calibration under large initial perturbations. IEEE Robotics and Automation Letters. https://doi.org/10.1109/LRA.2026.3683597
Questions for authors
Evaluate with more recent baselines that are also singe-frame calibration methods.
May the authors identify X3Calib's failure cases? Providing axis-wise errors for both rotation and translation error could help in determining this.
Minor nit: For the qualitative figures (Fig 2 and 4), change the depth scale to make closer objects more distinguishable.
We thank Reviewer WZ8U for the review and the pointers to recent methods. We are glad that the reviewer recognizes the need to evaluate across several sensor rigs, since KITTI and nuScenes each offer one extrinsic, and finds matching in 3D, rather than between 2D and 3D features, well motivated. The global response explains the updated schedule and the new baselines (Tables R1–R3). Triples give recall (%) at (1°, 0.25 m) / (5°, 0.5 m) / (10°, 1 m).
W1, Q1. How does X3Calib compare with newer single-frame methods? Two of them, BEVCalib [1] and CalibBEV [2], calibrate in a BEV grid, like X3Calib.
First, a clarification: X3Calib uses no BEV grid. It registers the LiDAR scan with the depth-lifted image cloud directly in 3D and solves for the pose from explicit correspondences, which, as Reviewer ekLy notes, “improve interpretability and facilitate subsequent error analysis and modular improvements.”
We ran BEVCalib [1], which releases code and trained weights, on all four datasets with its released preprocessing; CalibBEV [2] releases neither. We also added PseudoCal, the closest prior work, trained by us (global response).
W2. Is the Identity baseline necessary? If the true extrinsic is not the identity, its error seems meaningless, and CalibNet's errors are on the same scale.
We agree that the name misleads, and we rename the baseline No correction (initial extrinsic). It applies the identity correction, not the identity extrinsic: it returns the perturbed initial extrinsic unchanged, so its error equals the perturbation. Because the perturbation is bounded, this floor already scores 13–16% at (5°, 0.5 m) and 47–52% at (10°, 1 m) (Tables R1, R2); a method below it makes calibration worse than not running it. That CalibNet's errors lie on the same scale is what the row reveals: zero-shot, CalibNet falls below the floor on all three unseen datasets (Tab. 2 of the paper), as do BEVCalib and PseudoCal (Table R2).
Q2. What are X3Calib's failure cases? Per-axis errors would help to identify them.
Table R8. Per-axis median error of X3Calib, rotation (°) and translation (m; z = optical axis)
No correction: 3.4–4.0° and 0.24–0.26 m per axis.
Table R9. Zero-shot recall at (5°, 0.5 m) by correct matches per frame (uses ground truth), for the 25% of frames with the most matches agreeing with the final pose (no ground truth), and overall
–: at most one frame.
Minor. Could the depth colour scale in Figs. 2 and 4 make close objects easier to distinguish?
Agreed. The revised figures colour points by inverse depth, which spreads out the near range.