- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this work, the authors provided an effective pipeline, MEOW, to acheive the feed-forward 3D reconstruction from mixed and unconstrained camera types, without the need of the related camera parameters, such as intrinsics, distortion parameters and so on. Besides, the authors also proposed a laser-scanned benchmark, which is beneficial for a heterogeneous-camera reconstruction community.
The proposed procedural data engine, LENSCOPE, firstly generates diverse scenarios and corresponding panoramas and depth maps, and then sample the mixed-camera views with sufficient covisibility. Meanwhile, MEOW leverages the synthetic camera distrbution fine-tuning on MayAnything to learn the implicit correspondence between different projection models and camera rays, achieving the feed-forward 3D generation with the mixed camera type.
Critical strengths
a) The high-quality synthestic multiple camera type data is providede from the proposed Lenscope and the authors specifically designed the camera sampling, covisibility verification and accurate geometric supervision for sufficient fine-tuning.
b) The images, from different projection model, could be directly used as the input without any porjection transformation. The designs of resizeing without cropping and aspect-ratio embedding subtly injuce the camera projection information into the model.
c) The performance on both the 2D3DS benchmark and the self-captured benchmark demonstrated the superior capability of MEOW.
Critical weaknesses
Although the conducted experiments in this paper show that MEOW is an promising data-centric adaptation framework for camera-agnostic feed-forward 3D reconstruction, I have the following major concerns:
-
Less convinced technical novelty. After carefully reading this work, I found the main contribution is the proposed data engine and data preparison. While the network architecture is largely inherited from MapAnything, the simple finetuning on the synthestic data already brought the obvious performance improvement, as shown in Tab.8, Appendix and the following training with the addtional two stages even decreased the performance of Acc. and Comp.. Especially, combined with the ablation study in Tab.4, the reason of final performance improvement is unclear, where there are over 800-epoch training on one branch in stage 3. More controlled experiments are required, such as just continuously finetuning the MapAnything with same budgets.
-
Lack of comparison with the closest baseline, CAM3R. I recognized that CAM3R didn't release the multi-view weights, but the exclusion is somewhat sufficient. CAM3R has already reported multi-view reconstruction results on the 2D3DS dataset, the authors could potentially evaluate MEOW under CAM3R's published evaluation protocol and compare against its reported results.
-
Insufficient experimental justification for the motivation. Since authors viewed direct heterogeneous-camera inputs as the motivation and highlighted the limitations of rectifying wide-angle images to perspective views (L68-74), a direct comparison with a perspective-conversion pipeline based on MayAnything could help clarify the motivation (the calibration might be estimated by some existing methods, such as AnyCalib[1], CalibAnyView[2]).
Minor Concerns:
- More generalization results on real-world data. In this work, some camera types are sampled from panoramas. More experiments with the heterogeneous capture could better explain the robustness. For example, the fisheye images are from some ego-glasses, and the perspective images are from phones or GoPro.
- The limitations in multi-views and out-of-scope perspective videos . More discussion for the results in Tab12. and Tab.14 could better clairfy the performance.
[1] Tirado-Garín, Javier, and Javier Civera. "AnyCalib: On-manifold learning for model-agnostic single-view camera calibration." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025. [2] Li, Boying, et al. "Calibanyview: Beyond single-view camera calibration in the wild." arXiv preprint arXiv:2605.14615 (2026).
Questions for authors
See weakness.
4 comments
Thanks for the detailed response and the additional experiments. They address much of my original concern.
My main remaining question is how much the full training recipe adds beyond continued fine-tuning on LENSCOPE. At the same 15-epoch budget, the full recipe improves full-FoV 2D3DS mAA from 56.6 to 60.9, but scores slightly lower on cropped 2D3DS and drops from 74.5 to 72.5 on the laser mixed track, which also uses full-FoV inputs. This leaves it unclear whether the full recipe offers a consistent benefit over continued fine-tuning on LENSCOPE.
Could you extend both Run A and Run C from the same Stage-1 checkpoint to a longer matched budget, for example 90 epochs, and evaluate them under the same settings? This would help clarify how much the full recipe adds beyond continued fine-tuning alone.
**Matched-budget comparison at 60 epochs**
We are glad that the earlier responses addressed much of the reviewer's original concern. The requested comparison is reported below.
Both runs were extended from their 15-epoch checkpoints with the same seed, scenes and hardware. Entries are A / C under the settings of the earlier table, re-evaluated in the same environment.
| Epochs | 2D3DS, full FoV | 2D3DS, cropped | Laser mixed |
|---|---|---|---|
| 15 | 56.65 / 60.93 | 63.18 / 62.89 | 74.55 / 72.39 |
| 60 | 60.74 / 68.20 | 64.38 / 70.01 | 76.22 / 78.11 |
At 60 epochs the full recipe is ahead in all three settings, by 7.5, 5.6 and 1.9. Training continues, and we will report results at 90 epochs within the discussion period.
For context on the longer schedule: under the same protocol, the historical checkpoints of the released model change by about four points on full-FoV 2D3DS between 90 and 859 epochs, while laser-panorama AUC@30 rises from 47.9 to 73.0. The matched-budget runs A and C assess the contribution of the full recipe separately.
**Update: matched-budget comparison at 90 epochs**
Both runs have now reached 90 epochs under the same conditions as before. Entries are A / C; the earlier rows are repeated for reference.
| Epochs | 2D3DS, full FoV | 2D3DS, cropped | Laser mixed |
|---|---|---|---|
| 15 | 56.65 / 60.93 | 63.18 / 62.89 | 74.55 / 72.39 |
| 60 | 60.74 / 68.20 | 64.38 / 70.01 | 76.22 / 78.11 |
| 90 | 63.19 / 68.74 | 65.69 / 72.07 | 77.76 / 79.66 |
In our observation, both runs largely converge around 70+ epochs. At 90 epochs the full recipe remains ahead in all three settings, by 5.6, 6.4 and 1.9. The cropped and laser mixed margins are close to those at 60 epochs (5.6 and 1.9). The full-FoV margin is smaller than at 60 epochs (7.5), in line with the checkpoint-to-checkpoint variation noted earlier.
Response to Reviewer p5zb
Response to Reviewer p5zb
W1. Contribution and the requested control. MEOW is a data-centric adaptation, as the reviewer says and as the paper states: heterogeneous-camera reconstruction is treated as a data problem rather than an architectural one. The contribution is the engine that makes the adaptation possible and its result, the first model to reconstruct mixed tuples with full panoramas in one pass from images alone; extending pretrained models through data is an established route to new capability [1,2]. The requested control is below. Runs A and C start from the same Stage-1 checkpoint with identical scenes, seed and 6,240 updates.
With the architecture unchanged, every checkpoint adapted on LENSCOPE is far above the MapAnything it descends from. The added components contribute at every budget: +4.3 at 15 epochs; 76.6† with the aspect-ratio embedding against 70.6† without it after 90 Stage-3 epochs; and 23.2 lost when the embedding is withheld from the released weights. The 859 epochs are history, not a requirement: 76.6† after 90 epochs, 80.6† after 859. On Acc. and Comp., Table 8 was unclear: it compared Stage 1 under its crop loader with later stages under full-field-of-view resizing. Under one loader accuracy improves from 0.169 m to 0.142 m and completeness stays within 0.02 m.
W2. CAM3R. CAM3R released a checkpoint on 20 October, after the submission. It covers the two-view network, without the multi-view alignment or the preprocessing that defines its test sets, so its Table 2 cannot be matched input for input. Under its scoring MEOW reaches 81.2 mAA@30 on 2D3DS tuples of up to eight views and 53.7 over all 88 tuples including those of 15–24 views; CAM3R reports 73.5 on its own image sets, with global alignment and after training on Areas 1–4 of the same dataset. On identical image pairs in both input orders:
MEOW is ahead on all three sets, by 43 and 60 points on the two that neither model has seen; CAM3R is ahead on panorama pairs of 2D3DS, its training dataset.
W3. Perspective conversion. Lines 68–74 were too brief. We built the pipeline: virtual perspective views covering the full field of view, MapAnything (CC BY-NC v1.1), and ground-truth or AnyCalib calibration with the camera family given. CalibAnyView's multi-view mode assumes intrinsics shared across views, which mixed lenses violate.
Point error without scale fitting: on the laser mixed track, 0.98 m for MEOW against 0.82 m and 0.83 m for conversion with ground-truth and AnyCalib calibration; on 2D3DS, a mean of 0.87 m against 8.46 m and 18.4 m. Given the camera model of every image, which MEOW does not need, conversion gains 0.16 m on the laser office, loses on 2D3DS, and takes five times as long.
Minor 1. Real heterogeneous capture. We added the requested evaluation using independently calibrated physical cameras. In a laser-scanned office we calibrated and localised five physical cameras. We had no smart glasses, so the fisheye source is a calibrated action camera, a GoPro HERO4 Session. Perspective views come from two phones of different makes, an iPhone 12 Pro Max and a Xiaomi 17 Pro with its main and ultrawide lenses, and from a Fujifilm X100VI; panoramas come from an Insta360 X3. On mixed tuples built as in the mixed track of the paper, MEOW reaches 70.5 AUC@30 against 29.9 for the best baseline.
Minor 2. Tables 12 and 14. Both tables mark the range of the adaptation data, room-scale tuples of 2–8 views, as Section 5 states. In Table 14 MEOW leads Wid3R on 79 of the 88 tuples and at every size up to 14 views, beyond that range (67.9 against 56.9 at 9–14 views); only the four tuples of 15–24 views fall behind. Table 12 is video with centimetre baselines: every model solves rotation (RRA@30 of 99–100), and the differences lie in the translation direction of very small motions. At room-scale baselines MEOW stays within 1.1 AUC@30 of its backbone on perspective input (85.7 against 86.8, Table 3).
† Submission ground truth; other 2D3DS values follow an axis-convention fix in the ground truth (every method +0.1 to +0.5 mAA@30, no ranking change, weights unchanged).
[1] Duan et al., Fisheye3R, ECCV 2026. [2] Yang et al., Depth Anything V2, NeurIPS 2024.