- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Bounded Contextual Refinement (BCR) for text-aerial person retrieval. It combines bounded residual feature calibration, reciprocal gallery context for candidate selection and ranking, and auxiliary supervision from generated aerial descriptions. The framework addresses appearance ambiguity in aerial imagery and demonstrates improvements on AERI-PEDES and TBAPR.
Critical strengths
- The method effectively connects incomplete aerial appearance cues with the need for contextual evidence from other gallery images. Separating top-candidate selection from subsequent ranking is well motivated.
- Bounding feature updates and preserving the initial top-five and top-ten candidate sets provide explicit control over the refinement process.
- On AERI-PEDES, BCR improves Rank-1 from 47.16% to 49.29% and mAP from 44.79% to 47.70% over CFAN with ground-view supervision. The improvements in mAP and mINP on both benchmarks further support the value of contextual ranking.
- The paper proposes a targeted solution to key challenges in text-to-aerial person retrieval, demonstrating a degree of novelty.
Critical weaknesses
- The paper specifies the residual bound, reciprocal-neighborhood size, and neighborhood mixing coefficient, but barely explains their selection. Please describe the selection criteria and validation procedure, and whether both datasets share these settings.
- Section 3.4 states that the same frozen vision-language model generates descriptions and checks clothing, footwear, and carried objects against the image, removing unsupported attributes. Please provide an example with the source image, initial and reviewed descriptions, highlighting removed or corrected attributes and explaining how ambiguous, occluded, or unverifiable details are handled.
Questions for authors
- The paper specifies the residual bound, reciprocal-neighborhood size, and neighborhood mixing coefficient, but barely explains their selection. Please describe the selection criteria and validation procedure, and whether both datasets share these settings.
- Section 3.4 states that the same frozen vision-language model generates descriptions and checks clothing, footwear, and carried objects against the image, removing unsupported attributes. Please provide an example with the source image, initial and reviewed descriptions, highlighting removed or corrected attributes and explaining how ambiguous, occluded, or unverifiable details are handled.
- Figure 2 combines description generation, encoder adaptation, feature calibration, and contextual scoring, but some text and arrow labels are small. Please enlarge key annotations and indicate the training order, frozen modules at each stage, and inference pathway.
- The method section would benefit from clearer exposition. The numerous equations and limited intuitive explanations make the approach difficult to follow. I suggest highlighting the core ideas and adding explanatory text where needed.
5 comments
Response to Reviewer ZTF3
Q1: The paper specifies the residual bound, reciprocal-neighborhood size, and neighborhood mixing coefficient, but barely explains their selection. Please describe the selection criteria and validation procedure, and whether both datasets share these settings.
A1: Thank you. This question corresponds to W1, and the added validation results are reproduced in Table J below. Both datasets use ρ = 0.1, k = 4, α = 0.25, M = 5, L = 64, c₁ = 0.05 and c₂ = 0.02, with intervals [2, 5], [6, 10], [11, N]. The design limits feature and score changes, favors local support and the image’s own score, and preserves the initial top-five and top-ten sets.
For validation, one training-identity fold is excluded from both scorer-fitting queries and candidate galleries: 1,174 identities on AERI-PEDES and 393 on TBAPR. The encoder and BFC remain fixed after training on the full training split. This is conditional validation of the scoring stage, and no test identities are used.
Table J: Scorer validation on training identities excluded from scorer fitting (%; encoder and BFC fixed).
| Setting | AERI-PEDES Rank-1 | AERI-PEDES mAP | TBAPR Rank-1 | TBAPR mAP |
|---|---|---|---|---|
| Direct ranking | 69.36 | 67.95 | 63.08 | 55.57 |
| Default refinement | 69.87 | 68.88 | 63.95 | 56.19 |
| k = 3 | 69.86 | 68.72 | 64.08 | 56.07 |
| k = 5 | 69.92 | 68.95 | 64.08 | 56.30 |
| α = 0.20 | 69.87 | 68.74 | 63.95 | 56.09 |
| α = 0.30 | 69.87 | 69.00 | 63.95 | 56.28 |
Default refinement improves validation Rank-1/mAP by +0.51%/+0.93% on AERI-PEDES and +0.87%/+0.61% on TBAPR, using unrounded metrics. Nearby k and α values retain similar gains. Section 4.2 specifies the shared settings, Appendix H reports all sensitivity tests, and Appendix I describes the validation protocol and results.
Q2: Section 3.4 states that the same frozen vision-language model generates descriptions and checks clothing, footwear, and carried objects against the image, removing unsupported attributes. Please provide an example with the source image, initial and reviewed descriptions, highlighting removed or corrected attributes and explaining how ambiguous, occluded, or unverifiable details are handled.
A2: Thank you. The example introduced in W2 is reproduced here. The same frozen Qwen3-VL-8B-Instruct model first drafts a description and then reviews it against the same aerial training image. Neither pass receives a ground-view image or a released annotation. The retained model and prompts, with deterministic decoding, reproduce the reviewed description stored in the training cache.
Draft: "Person wears a dark short-sleeved shirt, light blue jeans, and dark sneakers with white soles. Carries a brown bag with a visible pattern over their right shoulder."
Reviewed: "Person wears a dark short-sleeved shirt, light blue jeans, and dark footwear. Carries a brown bag with a discernible pattern over their right shoulder."
The review retains the visible coarse category “dark footwear” and removes the unverifiable shoe type and sole color. The prompt asks for coarser visible categories for ambiguous details and omission of occluded or unverifiable attributes. The change from “visible pattern” to “discernible pattern” is wording only. Figure A9 in Appendix F.4 pairs the source image with both descriptions and highlights removed and retained attributes. Section 3.4 explains the procedure. The reviewed text provides auxiliary supervision alongside the released primary annotations.
Response to Reviewer ZTF3
Q3: Figure 2 combines description generation, encoder adaptation, feature calibration, and contextual scoring, but some text and arrow labels are small. Please enlarge key annotations and indicate the training order, frozen modules at each stage, and inference pathway.
A3: Thank you for the helpful suggestions. Figure 2 identifies the four training stages. Sections 3.1–3.4 clarify the training order, the trainable and frozen modules, and the inference procedure. Table K summarizes these stages.
Table K: Training stages and inference of BCR.
| Stage | Trained or generated | Frozen or reused |
|---|---|---|
| 1. Prepare ADS descriptions | Draft and reviewed descriptions, generated once and cached | Vision-language model |
| 2. Adapt the encoder | CLIP encoder initialized from CFAN, with primary and auxiliary objectives (5 epochs) | Cached descriptions |
| 3. Fit BFC | Residual matrix W (49 epochs) | Encoder |
| 4. Fit RCR | h₁ (20 epochs), then h₂ (20 epochs) | Encoder and BFC; also h₁ while fitting h₂ |
| Inference | No training; text encoding, scoring against the cached calibrated gallery, candidate selection and interval ordering | All modules; no description generation |
The freezing order makes the dependency between stages explicit. BFC is fitted on the adapted encoder’s fixed features. Both RCR scorers then use fixed encoder/BFC outputs, and h₁ is additionally frozen before h₂ is fitted. At inference, the gallery encoding, calibration and gallery graph can be reused across queries; the vision-language model is absent from the retrieval path. These distinctions separate offline preparation, parameter learning and query-time computation.
Inference uses the adapted text encoder, scores the cached calibrated gallery, selects the first result and orders the remaining candidates within intervals. Section 3.1 clarifies that inference processes every query without description generation or identity labels; training-query filtering is used only to fit the scorers.
Q4: The method section would benefit from clearer exposition. The numerous equations and limited intuitive explanations make the approach difficult to follow. I suggest highlighting the core ideas and adding explanatory text where needed.
A4: Thank you for this suggestion. BCR first makes a small adjustment to aerial features to improve identity discrimination, then uses neighboring gallery images to support the ranking. This provides a simple intuition for BFC and RCR before introducing their equations.
In BFC, the residual determines the update direction, the norm cap limits its size and the identity connection retains the input feature. In RCR, a candidate receives stronger support when visually related images also match the query. Bounded corrections select the first result, and neighborhood evidence orders the remainder within intervals that preserve the initial top-five and top-ten sets.
The two scorers also have an intuitive division of roles: h₁ reads a candidate’s context directly, while h₂ measures it relative to the other selection candidates through centered context features. The first-result decision and interval ordering therefore use context for different purposes: choosing the leading match and organizing the remaining relevant images. This explanation accompanies the mathematical definitions in Section 3.3.
We added these explanations before and alongside the equations in Sections 3.2 and 3.3.
Response to Reviewer ZTF3
A1: Thank you for the question. Both datasets use ρ = 0.1, k = 4, α = 0.25, M = 5, L = 64, c₁ = 0.05, c₂ = 0.02 and intervals [2, 5], [6, 10], [11, N]. Each model is trained on its own dataset's released split and CFAN initialization; the refinement settings are shared.
These values limit the feature update, keep neighborhood support local and give each image's own score the larger weight in interval ordering. The selection depth and intervals preserve the top-five and top-ten sets. Tables C, G and H test sensitivity around these fixed defaults.
For validation, we excluded one of three training-identity folds—1,174 identities on AERI-PEDES and 393 on TBAPR—from both scorer-fitting queries and candidate galleries, then evaluated on that fold with its own gallery. The encoder and BFC remain trained on the full training split, so this validates the scoring stage conditional on those representations. No test identities are used.
The held-out identities are excluded from both the queries and candidate galleries used to fit the scorers. This directly tests refinement on identities outside scorer fitting while retaining the learned representation. The sensitivity tables vary one parameter at a time around the same defaults; the validation table checks whether the default refinement and nearby k/α values also improve ranking on this separate training-identity fold.
Table J: Scorer validation on training identities excluded from scorer fitting (%; encoder and BFC fixed).
The defaults improve validation Rank-1/mAP by +0.51%/+0.93% on AERI-PEDES and +0.87%/+0.61% on TBAPR, with similar gains at nearby k and α values. Section 4.2 specifies the shared settings, and Appendix I describes the validation procedure.
A2: Thank you for this suggestion. The same frozen Qwen3-VL-8B-Instruct model first drafts a description and then checks it against the same aerial training image. Neither pass receives ground-view images or released annotations. The review prompt asks the model to retain coarser visible categories when fine details are unclear and to omit occluded or unverifiable attributes.
We reproduced the following pair on an AERI-PEDES training image using the retained model, prompts and deterministic decoding. The reviewed text matches the cached description used for training.
Draft: "Person wears a dark short-sleeved shirt, light blue jeans, and dark sneakers with white soles. Carries a brown bag with a visible pattern over their right shoulder."
Reviewed: "Person wears a dark short-sleeved shirt, light blue jeans, and dark footwear. Carries a brown bag with a discernible pattern over their right shoulder."
The review replaces “dark sneakers with white soles” with “dark footwear” because the shoe type and sole color cannot be verified at this resolution. It retains the visible coarse category. The change from “visible pattern” to “discernible pattern” only adjusts the wording.
The review prompt ties fine-grained attributes to visible image evidence and requests a coarser category or omission when that evidence is absent. In this example, the useful evidence that the person wears dark footwear is preserved while unsupported shoe-type and sole-color detail is removed. This keeps the auxiliary description focused on the appearance information available in the aerial view.
Figure A9 in Appendix F.4 shows the source image and both descriptions, with removed details in red and the retained category in blue. Section 3.4 explains how uncertain attributes are handled. Reviewed descriptions provide auxiliary supervision; the released annotations remain the primary training data.