- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 2
Read review
Paper summary
The paper presents FAR, a closed-loop framework for active UAV reconstruction using panoramic RGB images and known metric camera poses. A Spherical Ray Adapter conditions a pretrained geometry model on viewing rays and camera poses, while triangulation-based scale alignment and persistent voxel refinement produce consistent metric geometry across successive image windows. The planner uses this geometry to identify structure-anchored frontiers and select the next capture position, with voxel resolution and viewpoint-sampling parameters initialized from the scene scale. The paper also introduces a simulation platform and the FAR26 benchmark. Experiments on Macarons++ and FAR26 report improved depth and reconstruction accuracy, while planning experiments show higher coverage per unit flight distance. Component ablations and downstream Gaussian Splatting results provide additional evaluation of the reconstruction pipeline.
Critical strengths
- The integration addresses a useful problem. Panoramic observations simplify viewpoint selection, while metric alignment and persistent refinement provide a practical connection between feed-forward geometry prediction and active reconstruction.
- The reconstruction results are encouraging. Table 2 shows consistent improvements in depth and geometry on both datasets. Table 3 also supports the usefulness of the reconstruction components.
Critical weaknesses
- The contribution appears incremental. SRA closely follows UCPE, the voxel backend builds on AMB3R, and routing adapts FUEL. The integration is sensible, but the methodological advance beyond these components remains limited. The paper should clarify which adaptations are essential for panoramic active reconstruction and what additional benefit they provide.
- Hyperparameter sensitivity analysis. The scale coefficients in Eq. (5) and the stopping ratio in Eq. (8) affect map resolution, viewpoint selection, and the balance between coverage and flight distance. Using one setting across scenes is encouraging, but sensitivity study would help establish how robust the reported gains are.
- The effect of scale adaptation on fine details is unclear. Voxel size grows with the overall scene extent, whereas local structures do not necessarily become larger. Coarser aggregation may therefore weaken the representation of small structures and the frontier signals used to observe them. A comparison with a finer fixed resolution would help show whether the scaling rule preserves local detail while maintaining efficiency.
- The ablation does not sufficiently explain the coverage gains. Table 1 compares geometry sources, while Table 3 evaluates reconstruction components only through depth and geometry metrics. The contribution of Adaptive Initialization to coverage remains untested. Comparing fixed versus scale-adaptive parameters, and persistent versus per-window voxel refinement, using coverage–path curves would better explain the system’s improvements.
Questions for authors
- Parameter selection. What criterion was used to choose the coefficients in Eq. (5) and the stopping ratio in Eq. (8)? Are they tied to a desired spatial resolution or coverage target, or selected through empirical tuning?
- Scene scale. How is the task boundary B specified in practice: as a tight region around the target structure or a broader flight region? Since its volume determines voxel size, this distinction matters for understanding the scale-adaptation rule and its ability to retain local detail.
6 comments
Response to Reviewer eJ88, Q2, Q3 and Q4
Reply to Q2:
Thank you for this suggestion. We performed a 5 × 5 sweep of α (voxel size ρ = αL) and η with GT depth over 11 scenes, using multiple start positions per scene (Table R10 and Table R11). Each setting is shared across all scenes. The default is α = 0.0273 and η = 0.07, with 85.6% coverage in this sweep.
Changes in coverage at ε = 1.0 m relative to the default, in pp:
Table R10. Coverage changes relative to the default setting (pp).
| α / default α | η = 0.03 | η = 0.05 | η = 0.07 | η = 0.10 | η = 0.15 |
|---|---|---|---|---|---|
| ×0.5 | −1.0 | −1.2 | −1.4 | −1.5 | −1.9 |
| ×0.7 | +1.6 | +1.6 | +0.9 | +0.7 | 0.0 |
| ×1 | +0.5 | +0.3 | 0 (default) | −0.3 | −1.5 |
| ×1.4 | −1.6 | −1.8 | −2.0 | −2.3 | −2.9 |
| ×2 | −3.6 | −3.6 | −3.7 | −3.8 | −4.4 |
Path length relative to the default:
Table R11. Path length relative to the default setting.
| α / default α | η = 0.03 | η = 0.05 | η = 0.07 | η = 0.10 | η = 0.15 |
|---|---|---|---|---|---|
| ×0.5 | 1.76 | 1.63 | 1.54 | 1.41 | 1.25 |
| ×0.7 | 1.51 | 1.44 | 1.33 | 1.25 | 1.14 |
| ×1 | 1.19 | 1.09 | 1.00 (default) | 0.94 | 0.87 |
| ×1.4 | 0.88 | 0.86 | 0.83 | 0.79 | 0.76 |
| ×2 | 0.67 | 0.67 | 0.66 | 0.65 | 0.63 |
α controls resolution and viewpoint selection. At η = 0.07, varying α over a fourfold range changes coverage by −3.7 to +0.9 pp. Coarse voxels can represent small structures with too few cells, exhausting frontiers prematurely. Finer voxels increase path length by 33–54% without a comparable coverage gain. The default balances coverage and path length.
η controls the stopping point. At the default α, increasing η from 0.03 to 0.15 shortens the path by approximately one quarter while reducing coverage by 2.0 pp, allowing adjustment to the flight budget.
Across all 25 settings, coverage changes range from −4.4 to +1.6 pp. The lowest coverage is 81.2%, still above MAGICIAN's 79.4% and EPIC's 65.6%. These results indicate that the performance advantage does not require precise parameter tuning.
Reply to Q3:
Thank you for this observation. We compared adaptive voxels with two finer fixed resolutions in large scenes, using the stricter ε = 0.5 m threshold to assess detail coverage (Table R12).
Table R12. Detail coverage and path length at different voxel resolutions.
| Scene | Voxel size (m) | Coverage at ε = 0.5 m | AUC at ε = 0.5 m under the same path budget | Path length (m) |
|---|---|---|---|---|
| Colosseum | 2.25 | 64.6% | 0.512 | 2477 (+53%) |
| Colosseum | 3.15 | 63.3% | 0.518 | 2103 (+30%) |
| Colosseum | 4.5 (adaptive) | 62.0% | 0.533 | 1615 |
| Dunnottar | 2.22 | 98.8% | 0.742 | 1883 (+34%) |
| Dunnottar | 3.11 | 98.0% | 0.783 | 1470 (+5%) |
| Dunnottar | 4.45 (adaptive) | 98.4% | 0.813 | 1401 |
The finest voxels improve final detail coverage by at most 2.6 pp but require 34–53% longer paths. Adaptive voxels achieve the highest detail AUC in both scenes under the same path budget. Scale adaptation thus balances detail and efficiency: finer fixed voxels provide small coverage gains at the cost of longer paths.
Reply to Q4:
Adaptive Initialization contributes 4.1 pp in coverage. Following your suggestion, we compared adaptive parameters with a fixed set, taking the adaptive values for Colosseum and applying them to every scene (Table R13). The added results are averaged over multiple start positions per scene; reference results are taken from Table 1 in the main paper.
Table R13. Planning component ablations.
| Setting | Coverage at ε = 1.0 m ↑ | Path length (m) ↓ |
|---|---|---|
| FAR | 85.6% | 1111 |
| w/o Adaptive Initialization (one fixed parameter set for all scenes) | 81.5% | 888 |
| w/o termination based on the peak ratio (η = 0) | 86.0% | 1345 |
| MAGICIAN | 79.4% | 1400 |
| EPIC | 65.6% | 1807 |
The shorter path with fixed parameters results from coarse settings exhausting frontiers and ending exploration early in small scenes. Redeemer's coverage drops from 93.2% to 72.8%, and Pantheon's decreases by approximately 12 pp. Removing termination based on the peak ratio gains only 0.4 pp in coverage while increasing path length by 21%.
We will include the coverage versus path length curves in the appendix. With fixed parameters, the curves stop earlier with final coverage 4.1 pp lower. Without termination based on the peak ratio, they extend after coverage nearly saturates, with little additional gain.
Response to Reviewer eJ88, Q5 and Q6
Reply to Q5:
α controls relative spatial resolution subject to planning efficiency, while η defines coverage saturation. Both objectives are independent of scene scale, and both parameters are shared across all 11 scenes without individual tuning.
α is chosen for mapping and planning efficiency. With ρ = αL and α = 0.0273, the characteristic scene length spans approximately 37 voxels. This count does not grow with scene scale, keeping mapping and planning costs bounded. The default is selected where coverage approaches saturation at an acceptable planning cost. Across the sweep, coverage gains are at most +1.6 pp; at η = 0.07, finer settings increase path length by 33–54% (Response 2).
η defines the saturation criterion. Acquisition stops when the active frontier count falls below 7% of its historical peak. This ratio is independent of metric scene scale.
Reply to Q6:
We use the official Macarons++ evaluation box as B, a region closely enclosing the target structure rather than a broader flight region. Consequently, ρ = αL scales with the target structure's extent.
Reply to the AI Disclosure Concern:
Thank you for raising this concern. The central "Omnidirectional View" panel in Figure 1 combines three elements: a 3D scene generated with OpenAI's ChatGPT Image based on one of our existing scenes, a photograph of our actual UAV, and a panoramic sphere in the upper left corner created from visual materials in PowerPoint. This composition illustrates omnidirectional acquisition, with the generated scene designed to enhance the sense of depth and convey this concept more clearly. All other result images in the paper were produced by our experiments, and we remain fully confident in the validity of our method and the accuracy of the reported results. We apologize for omitting this use of image generation from our AI Use Statement. We will revise this statement in the main manuscript to disclose the specific use of ChatGPT Image, and update the Figure 1 caption to identify the generated scene and explain the composition.
Response to Reviewer eJ88, Q1
Reply to Q1:
Thank you for your careful assessment. Our adaptations address the unavailability of ground truth (GT) depth in practice and the planning requirements of omnidirectional observations across different scene scales.
Planning. We introduce two designs for this setting:
Responses 5, 2, and 3 respectively explain parameter selection, sensitivity, and the effect on local detail.
Reconstruction. Our adaptations are as follows:
These adaptations also benefit active reconstruction. In the closed loop, FAR with SRA and alignment achieves 83.3% coverage and 0.634 AUC, retaining 97% of the coverage and 96% of the AUC obtained with GT depth. With the same planner, PanoVGGT achieves 69.2% coverage and 0.421 AUC (Table 1 in the main paper).