- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PAIMON learns language-conditioned aerial target tracking from simulation only. An action expert that outputs a short camera trajectory is trained together with a video expert that predicts future depth, joined by an asymmetric attention mask, and the video branch is dropped at inference. Simulated frames are edited toward real appearance with an image-editing model. On the authors' ATP platform PAIMON obtains the best average success against five baselines, and a small quadrotor test is reported.
Critical strengths
- Future depth is only a training signal, so inference needs no video rollout and the planning cost stays low. The separation is clean and the idea is easy to test.
- The evaluation includes environments outside the training sources, and the appendix reports honestly where PAIMON loses to baselines, which makes the main results more credible.
Critical weaknesses
- The sim-to-real claim is not matched by the evidence. The paper treats the sim-to-real gap mainly as an appearance gap, while the expert trajectories come from rules for reachability, visibility and collision. It is unclear how they match real quadrotor dynamics such as acceleration limits, actuator latency and disturbances, or how the simulator's camera geometry is matched to the cropped real images. The real-world test, a few episodes in a motion-capture lab with no quantitative results or baseline, shows that PAIMON can be deployed, not that it bridges simulation and reality as the title claims.
- Neither design component is validated on its own. ACTION-ONLY removes the video expert, the depth task, the cross-expert interaction and the extra capacity together, so it shows that the branch helps, not that action-conditioned future depth is the key factor. For appearance transfer, FID is measured against generic image datasets rather than real UAV footage, and structure preservation is shown only qualitatively, although editing starts close to pure noise and the paper notes that starting from pure noise changes the person's facing direction and count. Since depth, boxes and actions are copied unchanged to the edited frames, such drift becomes label noise. PAIMON-Raw is also better on the real-derived Juzizhoutou scene, and its Table 4 average is miscomputed.
Questions for authors
- For the real flights, how well was the target tracked, what failures occurred, and how are the camera intrinsics and policy outputs matched to the real vehicle?
- Can you isolate action-conditioned future depth, for example by predicting future RGB or current depth instead, or by detaching the auxiliary loss from the action branch?
- Is there a quantitative check that editing preserves the target's box, mask and depth edges?
- Since only a short prefix is executed at 2 Hz, how large are the open-loop errors over that prefix, given the large long-horizon yaw errors in Table 3?