- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper finds that existing off-the-shelf monocular depth estimation models are not robust across diverse camera settings. More specifically, it finds that a single model only excels in a certain range of camera configurations, and multi-model fusion can outperform single model.
Based on this finding, authors propose DepthAgent, an agentic framework which uses off-the-shelf expert depth models as tools to produce better depth prediction. More specifically, DepthAgent chooses some expert models, and runs inference of those models on the input image, then combines the output of different expert models.
Authors evaluate DepthAgent on benchmarks covering diverse camera configurations, including perspective, fisheye and panoramic, and DepthAgent shows a consistent improvement, compared with both single expert baselines and other fusion-based methods on each camera configuration.
Critical strengths
-
Though it is expected that existing monocular depth estimation models are not robust to diverse camera settings, this paper did thorough quantitative analysis on this. Their analysis cover both perspective-oriented and EPR-trained monocular depth estimation models, and show that multi-model fusion can bring consistent improvement.
-
DepthAgent provides more accurate depth predictions within a reasonably fast inference time. More specifically, DepthAgent outperforms all single expert baselines and other fusion-based methods in all perspective, fisheye and panoramic datasets, and its fast mode is only 0.5x the speed of running all 5 expert models.
-
The methodology is general in the sense that it can be applied to any given set of expert models, and the performance may potentially improve when export models become better.
Critical weaknesses
-
The novelty of building an agent is limited. The main methodology of building an agent used in this paper is: treating frozen expert models as tools, choosing which expert to call, and combining their outputs. This idea is used in [1]. Though the authors mention [1] in related works, there is not enough discussion on how DepthAgent differs from that, besides on a different task.
-
The evidence that no-retrain is needed to the depth agent when depth expert pool changes (Line 252) is not convincing, and the cost of re-training could be a limitation of this method when better expert models are available. In Appendix E, the author only did experiments of removing 1 expert and replacing an expert (UniDepth) with a similar model (UniDepthV2). Authors do not mention how to address cases when new models are added to the expert pool, and substantial changes are made to the expert pool (e.g. multiple models are removed/replaced/added).
-
The writing about how DepthAgent produces its output is not clear. In Sec 3.2, the author mentions DepthAgent does multi-turn execution of expert depth models, but there is little description on how DepthAgent produces output from the output of those expert depth models. Sec 3.1 mentions some available options, but are these options the same as those being used by the DepthAgent? From Fig. 5(b) and 8, it seems that DepthAgent is able to output “avg” of 2 outputs from expert models, but still, there lacks a detailed description on what options are available.
[1] FusionAgent: A Multimodal Agent with Dynamic Model Selection for Human Recognition. Jie Zhu, Xiao Guo, Yiyang Su, Anil Jain, Xiaoming Liu; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026, pp. 32756-32766
Questions for authors
-
Can authors highlight their novelty compared with prior work, especially FusionAgent, besides addressing a different task?
-
How should the agent adapt when new models are added to the expert pool or multiple models are removed/replaced?
-
Can authors clarify how DepthAgent produces its output based on output from expert models? Especially, what fusion options can DepthAgent perform, and are those options performed over the whole image or can be applied on a selected subregion of an image?