- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper tackles the task of soccer player recognition from broadcast images. For that purpose, a dataset is collected, based on SoccerNet data, and annotated semi-automatically and semi-manually. Player identities are associated to the player crops considered. Then, various models are tested on the dataset. A classifier based on face detection attributes, jersey colors attributes, and OCR-based jersey number attributes is provided, by fusing the output of the used pretained models (no training is performed). The system reports decent performances on the dataset considered, and outperforms the baselines tested.
Critical strengths
The paper is a clean computer vision paper, with a well-defined task, a dataset built for it, a model developed for it, and evaluated against existing prior work. There seems to be no methodological flaw, and overall, the paper is pleasant to read.
On the dataset tested, the proposed solution outperforms by far the baselines considered.
Critical weaknesses
One of the claimed contributions is the dataset constructed. However, the dataset mostly relies on the SoccerNet dataset annotations: the paper subsamples some part of SoccerNet, does some processing with pretrained models, reviews the outputs and derives player names manually. Then the paper claims to provide a new dataset/benchmark under a non-related SoccerNet name. This is not really fair, and probably a coordination with the SoccerNet team (which is very active) should be made to ensure this is a legitimate way to proceed.
Besides, what is even more surprising, is that the provided annotations are very small-scale (1k instances), while SoccerNet already provides essentially the same data for 340k+ instances, just without player names. Still, 106k+ jersey numbers are provided, which can be directly associated to a player name with the match metadata (collected by the authors of the present paper). So, unless I completely missed the point, the paper could have done much more with all the data available, and I do not see why the presented approach might be substantially more interesting.
Finally, the paper seems to solve a useless, factice problem. In practice, why would anyone try to recognize a player from a broadcast stream by looking only at just one small player crop? Videos are very long and identification of a player can be done at many times, and tracking an identified player (as done in SoccerNet tracking) seems much more valuable (considering one can associate the player with its name with the metadata). Also, the proposed pipeline starts from pre-cut crops of players, but getting them, sorting those that are useful or not, is a practical resource-heavy exercise completely dismissed here, which needs to be done in production. Finally, the method will be unable to deal with new faces, new players, because of the fixed reference bank for the classification. New players appear all the time, every year, so a more flexible system would be much more valuable.
Questions for authors
What is the benefit of the proposed approach over the numerous and existing SoccerNet annotations, and that really requires substantial human effort, thus giving the value of this dataset?
What is the usefulness of the proposed work in a more global applicative context, e.g. if a new game is played, what will work, not work, and how can this be improved?
9 comments
Response to Reviewer cz9N (2/3): W2/Q1 identity annotations
[W2 / Q1. What do the identity annotations add beyond numbers and match metadata?]
We appreciate the opportunity to clarify. SoccerCanon links 1,108 observations from 213 matches to 424 canonical player identities, so it can evaluate whether a difficult broadcast observation can be connected to the same real person across matches. Linking jersey numbers with line-ups, as the reviewer suggests, would give a much larger identity set, but a label of that kind exists only where a number is legible. Our audit of the 489 test labels shows that the jersey or shorts number settled only about half of the identities:
| Test queries | Count |
|---|---|
| Audit: identity settled by the jersey or shorts number | 249 of 489 (50.9%) |
| Audit: identity settled by another cue (face 229, scene context 3, other 8) | 240 of 489 (49.1%) |
| Automatic reading: OCR returns no digit string | 204 of 489 |
A set built from numbers and line-ups would therefore leave out the 49.1% of test identities that were settled by the face or other evidence, as well as many observations whose number the automatic reader cannot recover from the crop (no digit string for 204 of 489). These are exactly the cases SoccerCanon is built to evaluate. We therefore see the two approaches as complementary: number-and-line-up labels scale well where the number is legible, and SoccerCanon tests the harder cases with verified identities. Human verification is used only to create the ground truth; identification at inference is automatic. We will make the distinction between the existing SoccerNet annotations and the new cross-match identity labels explicit.
Response to Reviewer cz9N (3/3): W3 task motivation, Q2 crops and new players
[W3. Why study a single observation when video and tracking are available?]
Thank you for raising the downstream motivation. The task is motivated by background-knowledge image question answering, and our focus is the recognition challenge posed by broadcast observations with difficult viewpoints, blur and occlusion:
| Setting | Why identity grounding is needed |
|---|---|
| Background-knowledge image question answering (a related setting: SoccerBench Q4 [4]) | Before answering a question about a player, a system must ground the observed person to the correct identity, and a single-image question need not come with a video track |
| Video systems with tracking | Mapping a track to a real player still needs identity evidence, so the task can also be used as a component within a larger video system |
| Match metadata available | Narrows the candidates but does not name the player: shirt-number look-ups among the actual participants reach at most 19.6% R@1 (reply to Reviewer rXSr) |
Section 3.1 will make the evaluation scope clear.
[Q2. How are crops obtained, and how can the system accommodate new players or matches?]
Thank you for this practical question:
| Step | How |
|---|---|
| Test set: detection, crop generation (YOLOv8n-Pose) and candidate selection | Automatic |
| Identity labels | Established and verified by humans (ground truth only) |
| New player | Add reference photos and the roster entry; no retraining of the recognition model |
| Match information | Can be incorporated: the two teams' season squads or the actual participants can be placed first among the candidates |
| Harder case | Now | Next step |
|---|---|---|
| Player without a reference photo | Cannot be named | Update reference photos and rosters |
| Team without kit references | 75 team-seasons covered | Update kit references |
We will make the separation between automatic and human steps clearer in the description of the construction pipeline.
[4] Rao et al. (2025), Multi-Agent System for Comprehensive Soccer Understanding, ACM Multimedia 2025. Appendix C.1.4 (Background Knowledge Image QA) describes constructing image questions using SoccerWiki player photographs
Response to Reviewer cz9N (1/3): W1 / Ethics, provenance, name, consultation and release
We thank Reviewer cz9N for the careful review and the thoughtful questions. We answer W1 (ethics) in this comment, W2/Q1 in the second comment, and W3 and Q2 in the third.
[W1 / Ethics. Provenance, the name SoccerCanon, and coordination with SoccerNet]
Thank you for raising this. Clear provenance matters to us as well, and we answer the three points of the concern in turn.
(1) Does SoccerCanon rely on SoccerNet's annotations? No. SoccerCanon uses SoccerNet's images and videos, not its player annotations. From SoccerNet we take the action and replay frames released with SoccerNet-v3 [3], organized by match, and the corresponding match videos; the videos were used only by human annotators to verify identities and are never input to any model. The SoccerNet-v3 bounding boxes, jersey-number labels and player-correspondence IDs were not used at any stage, either by our pipeline or by the annotators. Player localization and the face, upper-body and number crops come from our own pipeline (Section 3.2.1, Appendix A.1). What SoccerCanon adds is a label that SoccerNet does not contain: human annotators linked each observation to a canonical real-world player, consistent across matches and seasons.
(2) Is the name fair to SoccerNet? The manuscript already names SoccerNet as the image source in the Introduction, Section 3.2, Figure 2, Appendix A.1 and the Ethics Statement, and cites Deliege et al. (2021) [2] and, in Section 3.2 and Appendix A.1, Cioppa et al. (2022) [3]. In the revision, the name SoccerCanon will denote only what is new, namely these canonical identity labels and the identification task built on them; the images remain SoccerNet's. We will state this in the abstract, the contribution list and Table 1, describing SoccerCanon as an identity annotation layer on SoccerNet-v3 frames, and we will add the original SoccerNet paper (Giancola et al., 2018) [1].
(3) Was SoccerNet consulted? Yes. Based on what we described, SoccerNet replied by email that they see no issue with the research from their side: using SoccerNet to construct and evaluate a new academic benchmark is consistent with its intended research use, provided that the original SoccerNet data and the derived benchmark are not redistributed and the relevant SoccerNet work is properly cited, and no additional permission is needed from them for the manuscript as described. SoccerNet recommended making clear in the paper that the benchmark is derived from SoccerNet and is not publicly redistributed, which we will do, and asked us to contact them before any public release of the derived benchmark. We can forward this written confirmation to the PCs if helpful.
What we release, and how. We will not redistribute any SoccerNet images or videos: no frames, crops or match videos. Third-party reference photographs and kit images are not redistributed either; they remain under their sources' terms. On publication we will release the code (construction pipeline, our method and the evaluation scripts); it contains no SoccerNet images. We do not release the benchmark annotations at this point. Should we release them, we will first contact SoccerNet, as they asked, and share only what they agree to, in this form: for each observation, a fixed observation ID, the canonical identity label, the SoccerNet game and frame identifiers, and the fixed pixel boxes of the player crop and of its face, upper-body and number crops in that frame, plus the frozen per-query rankings behind the reported results. Such files contain no image content, so users would obtain SoccerNet access themselves, under SoccerNet's terms, and rebuild each crop by cutting the frame at these boxes; no detector is re-run, so the crops do not depend on detector versions. We checked that this reproduces all 1,108 stored player crops and their face, upper-body and number crops pixel for pixel. We will revise the Ethics and Reproducibility Statements accordingly.
[1] Giancola et al. (2018), SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videos, CVPR Workshops 2018.
[2] Deliege et al. (2021), SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos, CVPR Workshops 2021.
[3] Cioppa et al. (2022), Scaling up SoccerNet with multi-view spatial localization and re-identification, Scientific Data 9, 355 (SoccerNet-v3).