- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents GeoPOI, a framework for geographically contextualized ASR built around a frozen Qwen3-ASR backbone. Given speech and observed geographic context, an audio-conditioned router selects a single geographic cell, a local neighborhood, or no contextual intervention. Within the selected region, the system uses span-aware acoustic retrieval and ranking to select POI candidates, while regional adapters modify decoder hidden states and trie-based biasing adjusts token logits. On the evaluation set, the combined system reduces whole-utterance CER from 8.33% to 5.93% and POI CER from 17.03% to 8.94%, while general-speech CER remains nearly unchanged.
Critical strengths
The paper addresses a practical problem in contextual ASR: geographic information can substantially improve POI recognition. The proposed routing and candidate-selection pipeline is designed to control this trade-off rather than always applying geographic biasing. The empirical results are also strong. On a reasonably large evaluation set, the combined system substantially reduces both overall CER and POI CER, while general-speech CER remains almost unchanged, suggesting that the gains are not simply obtained by sacrificing non-entity recognition.
Critical weaknesses
-
The task formulation is fairly narrow and tied closely to the observed user geography . The system defines a route from the current utterance and observed geographic context , and restricts retrieval to the corresponding POI pool . This makes sense for navigation or local-search queries, but it does not model broader conversational context. In realistic conversations, speakers may refer to places they visited previously, places they intend to visit, or places associated with another speaker, none of which need to be related to the current GPS location. The paper includes stress contexts with altered geography, but these mainly test robustness to incorrect context rather than whether the system can infer the relevant geography from dialogue history. As a result, it is unclear how well the proposed formulation generalizes beyond location-centric ASR scenarios.
-
The technical contribution appears somewhat limited, and a central routing component is under-specified. At a high level, the method combines two familiar contextualization mechanisms: a regional adapter that modifies decoder hidden states , and trie-based candidate biasing that adjusts output token scores, which are essentially applications of deep and shallow fusion. The span detector, bounded retrieval, ranking, and geographic sharding are useful engineering components, but they seem largely specialized to this geo-entity setting rather than constituting a fundamentally new modeling approach. More importantly, the three-state router depends on cell logits and a NONE logit , through quantities such as , , and . However, the paper does not adequately explain how these logits are produced or how the router itself is trained. Since this routing decision determines whether the system uses one cell, the GPS neighborhood, or no geographic context at all, the missing detail makes an important part of the method difficult to assess and reproduce.
Questions for authors
-
How are the routing logits and computed and trained? The paper explains how they are used for routing, but not clearly how the router itself is learned.
-
How is the observed geography related to the target POI in the evaluation set? In particular, how often is the correct POI actually contained in the routed pool ? Since the paper notes that the test geographic contexts are constructed, this seems important for judging how realistic the setting is.
-
Did the authors evaluate cases where the relevant POI is not tied to the speaker’s current location, such as a place mentioned earlier in the conversation, a place the speaker plans to visit, or a place associated with another speaker?
4 comments
Dear Reviewer,
Thank you again for your time and thoughtful review. We would appreciate your feedback on our point-by-point rebuttal, particularly whether the clarifications and additional results address your main concerns.
As the discussion period is nearing its end, could you please let us know if any key concerns remain? We would be happy to provide further clarification.
Thank you for your consideration.
Thank you for the detailed response. The added description of the router and the new routing experiment addresses my concern about how the routing mechanism is implemented and trained. However, the relationship between this new three-class router and the formulation in the original paper remains somewhat unclear, especially since the response states that the original component table uses fixed geography. This distinction should be clarified in the paper.
The additional nonlocal examples are useful, but they mainly test robustness when the target falls outside the local pool. They do not address my broader concern about applicability. The current formulation still assumes that the supplied geographic context is the relevant one, and does not infer the relevant location from the conversational context. I therefore remain unsure how well the method generalizes beyond location-centric POI queries. I think the work would fit naturally in a speech-centric venue, while I remain less convinced about its broader applicability for ICLR.
As a separate procedural note, the repository links included in the response do not appear to be anonymized. You may want to double-check the ICLR anonymity requirements for links shared during the review period.
Firstly, tks for your advice and i have changed my repository url.
And,Recognizing proper names, including POI names, from speech remains a challenging problem without a perfect solution in current industry practice. Context is necessary to resolve ambiguities such as homophones. Compared with some existing contextual biasing and hotword injection approaches, our method substantially improves generalization.
The current POI retrieval scope is sufficient to address 90% of the problems encountered in everyday ASR use. As you correctly point out, it cannot resolve certain recognition errors involving distant POIs. We believe that addressing these cases would require more resource-intensive training of the base model and more fine-grained attention mechanisms. Our current approach represents a practical trade-off between recognition performance and computational cost.
The router is also designed to improve generalization. In the current system, it relies primarily on GPS context and semantic information from the audio. Its interaction with the ASR model is central to our design: the routing decision determines the geographic scope for retrieving POI candidates, which are subsequently used to correct recognition errors. The paper does not investigate how to optimize routing for multi-turn dialogue or more complex contextual information. Extending the router to these settings is part of our ongoing work.
The trade-off between the accuracy and universality of near-field POI correction
Thank you for recognizing the practical value and recognition gains of GeoPOI. We agree that its scope, contribution, and routing mechanism need clearer explanation.
GeoPOI targets AI glasses, automotive systems, and mobile assistants. Chinese homophones and names mixing abbreviations, Latin-script text, and numbers make POI recognition difficult. Its contribution is the coordinated treatment of geographic scope, acoustic disambiguation, scalable regional learning, and preservation of general ASR, using established adaptation and decoding mechanisms around a frozen backbone.
Our data construction benefits from high-quality POI resources available through a large commercial social platform, including aggregate regional popularity signals and common request patterns. POI information is verifiable through official sources; expression patterns are cleaned, generalized, and stripped of sensitive user information. These resources support broad coverage of everyday POI formulations without establishing unrestricted conversational generalization.