- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents RECON, a framework for UAV navigation in reconstructed 3D Gaussian environments. It defines a replayability field using the number and angular coverage of scout views supporting each Gaussian. This field is provided to the navigation policy and is also used to generate training trajectories that avoid poorly supported regions. The method is evaluated in simulated environments and through real-UAV trials.
Critical strengths
- The paper studies whether a reconstructed scene remains usable when the UAV moves away from the views used to build it. This is a relevant issue for real-to-sim navigation.
- The evaluation includes both simulation and real-UAV experiments. The attempt to connect reconstruction quality with downstream navigation performance is useful, although the real-world evaluation is small.
Critical weaknesses
- The replayability field is not theoretically connected to geometric reliability. measures the amount of scout-view support, but the paper does not show that it bounds or consistently tracks depth error, free-space error, or collision risk. It also does not account for inaccurate depth, pose errors, incorrect Gaussian geometry, or other reconstruction artifacts. The reported correlations provide some empirical evidence, but they are not sufficient to justify treating as an estimate of world fidelity. There are also questionable details in the definition. In Equation (6), empty pixels contribute zero to both the numerator and denominator. They therefore do not reduce the final score, despite the statement that empty pixels contribute zero. A view with only a small, well-supported rendered region could receive a high value even when most of the expected geometry is missing. In addition, the angular quantity in Equation (5) is not generally equal to the actual span of the observed viewing directions.
- The experimental evidence is not strong enough to support the claimed improvement. Overall simulation success increases from 0.44 to 0.52, while the reported variation is relatively large. Performance in the difficult Large regime remains very low at 0.11. The real-world result is based on only 40 trials, and the difference between 0.70 and 0.65 corresponds to two additional successful flights. No confidence interval or significance analysis is provided for this result. The evaluation also does not fully separate the effects of the proposed components. RFM changes the policy input, while SCM changes the planner trajectories used as training demonstrations. Without a complete factorial ablation or an oracle comparison, it is difficult to determine whether the improvement comes from the replayability field, the changed demonstrations, or simply avoiding more difficult routes.
Questions for authors
- Under what assumptions should be related to depth error, free-space error, or collision risk? Can the authors provide any theoretical argument, bound, or failure analysis?
- In Equation (6), empty pixels contribute to neither the numerator nor the denominator. How does this definition penalize missing geometry?
- Why is the quantity $$\theta_i$) in Equation (5) defined as twice the maximum deviation from the mean viewing direction? This is not generally equal to the actual angular span. How is the degenerate case handled when the mean direction is close to zero?
- The support values are normalized using the best-supported Gaussian in each scene. Are the resulting (E(p)$ values comparable across scenes? Could this normalization affect the pooled correlation results?
- Can the authors provide a complete ablation that separates the effects of RFM, SCM, and the modified planner demonstrations?
- How does the proposed field compare with existing reconstruction uncertainty or confidence measures under the same experimental protocol?
- SCM plans trajectories using collision geometry from the reconstructed world. Since that geometry may itself be incorrect, especially in low-support regions, what prevents the planner from selecting an unsafe route that appears valid in the reconstruction?
- The paper describes the experiments as validating a causal chain. Correlation between , geometric error, and policy failure does not establish causality. Which experiment isolates the causal effect of the replayability field itself?
2 comments
Continuing from the equations to the experiments
Part 2 for Reviewer inZV, continuing from the equations to the experiments
Dear Reviewer inZV,
Thank you again. This note covers the experimental questions, from the strength of the evidence to the planner. The numbers are in Appendix G, and Table 2 keeps its values.
W2. Evidence for the gain. All methods fly the same starts. RECON beats +GTM in 15 paired comparisons and loses 3 (exact McNemar ), with a non-negative difference in 5 of 6 worlds. On evaluation slot 1 the paired gain is +0.097 (95% CI [0.028, 0.167]) and is non-negative in all 6 worlds. The standard deviations in Table 2 reflect world difficulty, which moves all methods together.
The Large result follows from the design. The same vehicle collects the scout and flies the policy, and a crash ends it, so and keep authorized flight where the scout constrained the clone. Large routes lie mostly outside that region, with 55% of their length below and a closest scout pose 8.7 m away. RECON still lifts Large success from 0.02 to 0.11, the highest of any method against 0.08 for the best baseline, and route-minimum flags the remaining failures before takeoff at AUROC 0.87. On such routes the field's job is to tell the pilot not to fly. On the physical flights every method uses the same 40 starts across four sites. RECON reaches 0.70 success with 0.15 collision or intervention, and the strongest image policy 0.65 with 0.20, the same order as in the paired simulation study.
Q5. Separating RFM, SCM and the demonstrations. SCM is the term in the planner that writes the demonstrations, and that planner is absent at test time, so SCM and the demonstrations form one factor. The four cells use the same worlds and success rule.
| field withheld | field visible | |
|---|---|---|
| SCM off | 0.44 | 0.48 |
| SCM on | 0.48 | 0.52 |
SCM alone matches the field alone, and the two together are higher. To separate the content of the field from the extra channel, we shuffle inside each world. The channel, the value distribution and the SCM demonstrations stay, and only the match between support and Gaussians is lost. Success drops from 0.52 to .
Q6. Reconstruction uncertainty. For this representation, the uncertainty of a centre is the Fisher information of its bearing observations, and follows the smallest eigenvalue of that information (Spearman 0.86). renders the signal in one pass, with no ensemble and no held-out photograph. Route-minimum predicts policy failure at AUROC 0.87 (Table 1), against 0.51 for nearest-scout distance and 0.68 for LPIPS, which needs the photograph at the query pose. In closed loop, the rank-matched nearest-scout field reaches 0.458 and reaches 0.52.
Q7. Whether the planner can trust the clone. The planner enforces clearance in the clone, and the occupancy no scout image constrained is exactly where . Eq. (8) charges there, with chosen on the validation worlds, so the cheapest path stays in the corridor the scout observed. Along flown trajectories the collision rate falls monotonically as rises (Spearman ). In one matched rerun of this comparison, demonstrations from the -weighted planner reach 0.491, those from the length-only planner 0.486, and the shuffled field 0.458.
Q8. Which comparison isolates the field. From +GTM to +GTM+RFM the architecture, demonstrations, step budget, optimizer and seeds stay fixed, and the only change is whether the policy sees and . That step raises overall success from 0.44 to 0.48. The shuffle then changes only the geometric assignment and lowers success from 0.52 to . Section 4.2 now names this matched module ablation, and Appendix G.2 reports the cells.
Thank you for holding the paper to this standard. We would be glad to walk through any of the new cells.
Part 1 for Reviewer inZV — on the definitions, pressed exactly where they should be
Dear Reviewer inZV,
Thank you for reading the paper down to the equations. Questions on Eqs. (5) and (6), on the normalization and on what each comparison changes are exactly the ones the definitions must answer, and we are grateful for that precision. This note covers the definition of the field, and a second note covers the experiments. Revised passages are in blue and the measurements are in Appendix G.
W1 and Q1. Why E tracks geometric error. Take a Gaussian centre constrained by the scout frames that pass Eq. (4), and assume known poses, independent bearing noise, comparable range and a locally identifiable objective. Poses come from AirSim in simulation and from the flight-controller trajectory after Sim(3) alignment in the field, in both cases before E is computed. Eq. (4) already drops the count of a centre whose depth disagrees with the scout frame. The Fisher information along the least-constrained direction is zero when the centre is seen once or from a single direction, and grows as niθi2 when the bearings spread over an angle θi. These are the two statistics in ei, so the worst-direction error falls as either one grows, and E renders that quantity at any pose (Appendix G.3).
The measurements agree. The smallest eigenvalue follows the published ei at Spearman 0.86 and tracks depth MAE at ρ=−0.67, with E at −0.58. Along flown trajectories the collision rate falls monotonically as E rises (Spearman −0.69), which links the field to collision risk on the routes the policy actually flies.
Q2. Empty pixels in Eq. (6). Eq. (6) averages support over the surface the clone renders, weighted by the opacity placed on it, which is the geometry the policy reads. A pixel without a splat makes no geometric claim and enters neither sum. In these outdoor views such pixels are sky and distant background, so counting them in the denominator would make E depend on how much sky the camera sees. On the fixed W12 clone a pitch sweep moves Eq. (6) by 0.022 and a full-image average by 0.163.
Q3. The angle in Eq. (5). θi measures the spread of viewing directions about their mean, the same axis that organizes the Fisher information above. For any set of directions it stays between the pairwise angular diameter and twice that diameter, with equality when the extreme bearings are symmetric about the mean. The bound holds whenever the resultant is non-zero, and the resultant never vanishes in the measured clones. Table 1 is therefore computed with a spread within a factor of two of the angular diameter.
Q4. Normalizing within a clone. E is linear in the per-Gaussian scores, so dividing by the best-supported Gaussian scales a clone by a positive constant and leaves within-world Spearman correlation and the scout quantile τ unchanged. Before that division the score already lies in [0,1], and every world uses 42 scout frames, so the raw values share a scale. The depth correlation of E is negative in all 6 test worlds, and the pooled ρ=−0.58 summarizes worlds that agree in sign. Across the catalogue τ ranges from 0.12 on the foliage-occluded validation orbit to 0.48 on a test world, a difference in scout support under the same frame count.
Thank you for pressing on these definitions. The second note turns to the experiments.