- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper provides a benchmark that reframes multi-transmitter deployment as physics-grounded spatial set planning under a unified ray-tracing verifier. On the top, the paper shows the possibility to compare some planning methods. Overall, the paper is easy to follow. But significant over-simplification exists.
Critical strengths
The paper put some efforts in simulating ray tracing for benchmarking the multi-cell deployment.
Critical weaknesses
-
The benchmark is simulated under over-simplified assumptions, including the material priors (only three, very coarse classification, whereas more material are general involved), the configuration of TX and RX single-element isotropic antenna with vertical polarization and zero azimuth orientation (whereas MIMO is standard in current cellular networks and coordinated multi-point in a building is common), and single carrier frequency (where inter-cell interference can be largely mitigated by different frequencies, and that is what makes cellular networks be called cellular networks).
-
I doubt the practical applicability and/or the target scenario of the benchmark. Cellular deployment is a complicated problem, which depends on the technical networking optimization and the practical deployable factors, such as agreement from residents. So, the current deployable mask is over-simplified as well and might not have a easy solution.
Questions for authors
Address my concern over assumptions and the target application scenario.
3 comments
Response to NiGN (2/2): W1, W2, Q — Materials and siting
W1 (materials), W2 and Q: Fidelity and application scope
Material priors. The three priors use Sionna's ITU-based concrete, medium-dry-ground and wet-ground models, with frequency-dependent electromagnetic coefficients (documentation). They are physical priors rather than measured material maps. The semantic assignment remains coarse: buildings/roads use concrete, land/green areas use medium-dry ground, and water uses a wet-ground proxy. Standards-derived coefficients do not establish that these assignments match each actual surface.
We therefore performed paired reevaluation of 120 fixed layouts per perturbation. Multiplying material conductivities by 0.8/1.2 yields mean absolute JM changes of 0.52/0.42 percentage points. These tests assess local coefficient sensitivity only; they do not validate the three-class assignment or rule out larger errors from glass/metal facades, vegetation or moisture. Site-specific accuracy requires richer material information and measurement calibration. We will explicitly distinguish simulation-grounded verification from empirical validation.
Target application. The concrete task is outdoor coverage-oriented placement of a fixed number of TXs in an urban region, given a candidate-site set and a radio/resource profile. It models the technical planning stage: choosing a jointly effective set from admissible locations. Resident consent, ownership and installation permissions determine admissibility through external processes. The benchmark does not infer those permissions from a map or certify that every road position is installable.
Once authorized sites are supplied, the planning constraint can be written as
Crucially, candidate locations and the area requiring service are separate inputs. Restricting where TXs may be installed must not shrink the area on which coverage is evaluated. This lets the benchmark test the technical consequences of site availability while keeping the coverage objective fixed.
We tested this distinction by replanning under restricted candidate sets. We retain 50% or 25% of candidate-bearing 20 m blocks, with three mask seeds, and separately restrict candidates to a 2 m band inside the road-mask boundary. The latter is a roadside geometry proxy, not a map of surveyed poles or approved installations. The reward models remain frozen; restrictions enter the search constraints and final feasible projection. TX counts, 20 m minimum separation and the original road evaluation area remain unchanged.
Table 3. Restricted-site Diffusion planning, JM (%). H4=orders 1–4 HPEM; CI=common-input IN. Both use 12,020 search reward evaluations plus 20 final reranking evaluations.
| Allowed candidates | H4 | CI |
|---|---|---|
| Original road candidates | 64.60±1.33 | 66.10±2.13 |
| 50% of candidate blocks retained | 63.90±1.21 | 65.33±1.17 |
| 25% of candidate blocks retained | 63.48±0.32 | 63.99±1.56 |
| Within 2 m of road-mask boundary | 61.95±1.38 | 59.43±2.67 |
These use the same three London/New York/Tokyo tasks as Table 1, with three training seeds and five planning seeds. We average planning/mask repetitions within task/training seed, equally weight tasks, and report mean±sample SD across training seeds. Table 3 uses new searches with a common candidate archive; its original-road row is not the fixed-layout baseline of Table 1.
Restricting H4 to the boundary band changes JM from 64.60% to 61.95%; retaining 25% of candidate blocks gives 63.48%. The results demonstrate planning with substantially reduced geometric availability, while quantifying the resulting coverage. They do not validate real permissions or guarantee feasibility for arbitrary candidate sets.
Research value. Real deployment requires several coupled decisions; a reproducible benchmark for spatial selection is useful within that larger workflow. Operator-ready validation additionally requires calibrated propagation, operational radio policies and verified site permissions; we will make this scope explicit. The ML challenge addressed here is learning and optimizing the utility of an entire spatial set under a costly physical evaluator and changing feasible regions. CityDeploy-Bench provides open scenes, deployment labels and a common evaluator for comparable studies of this challenge. The added experiments make spectrum allocation, antenna patterns and site availability testable conditions, allowing researchers to examine where learned planning succeeds and where it fails.
Feedback to the responses
Thanks for the input. Although the authors put a lot of effort into demonstrating the workflow's capabilities, their responses, in my opinion, also implicitly reveal the complexity and complications of the investigated scenarios, which the paper fails to address sufficiently. Moreover, their final statement suggests the title is somewhat overstated, or at least misleading. Therefore, I choose to maintain my score.
Response to NiGN (1/2): W1 — Radio assumptions
W1: Radio assumptions
Thank you for recognizing the effort behind the benchmark and for questioning its modeling scope. CityDeploy-Bench studies how to learn collective deployment utility and search for effective transmitter sets under specified physical conditions. Shared scenes, utility labels and ray-tracing evaluation make this learning/planning problem reproducible. We have tested several of the disputed assumptions directly.
The reference profile uses 3.65 GHz, 20 MHz, 24 dBm TX power and 10 m/1.5 m TX/RX heights. It retains urban blockage, specular/diffuse reflection, refraction and diffraction. Fixed antenna and resource settings isolate spatial planning; they do not constitute a complete cellular-system model.
Frequency reuse. We agree that frequency separation can mitigate interference. Reuse-one operation is nevertheless a legitimate cellular regime: 3GPP TR 36.902, §4.9 explicitly discusses co-channel interference and PRB-level coordination. An operational 4G/5G measurement study also reports persistent inter-cell interference (Ding et al., 2025). Thus, the reference investigates a relevant interference-limited condition, while frequency coordination is an important extension.
We reevaluate 90 fixed layouts: two utility models × three scene/TX tasks × three training seeds × five planning seeds. A geometry-based channel assignment partitions the same 20 MHz/51 PRBs into K groups. Noise, per-resource-element received power and throughput are recomputed using each group's bandwidth; only co-channel TXs interfere. Table 1 holds power spectral density fixed, so per-TX total power decreases with allocated bandwidth.
Table 1. Fixed-layout joint coverage JM (%) under frequency reuse.
JM is the fraction of road cells meeting all four thresholds: path loss, SS-RSRP proxy, SINR and effective throughput. H4=HPEM with orders 1–4; CI=IN with common input features. We average planning repeats within each task/training seed, then equally weight tasks; mean±sample SD is across three training seeds. The tasks are London/256 m/4 TX, New York/512 m/7 TX and Tokyo/512 m/9 TX.
Reuse 1→3 improves JM by 10.55/9.41 percentage points for H4/CI, even after accounting for reduced bandwidth and TX power. With fixed total TX power, the corresponding K=3 values are 72.06±1.29/72.70±3.61%. This directly quantifies the reviewer's proposed mitigation without granting extra spectrum. It also shows why conclusions must identify their resource regime. This test assumes frequency-flat gains over the original 20 MHz; it is not a full frequency-selective scheduling study.
Antennas and coordination. For the isotropic reference, zero azimuth does not impose a directional gain preference. Single-element vertical polarization provides a controlled starting point. To test antenna-pattern shift, we use a TR 38.901 directional TX element with 8 dBi peak gain, reduce conducted power to 16 dBm to retain 24 dBm peak EIRP, and point horizontal boresights toward the scene center; RXs remain isotropic. We rerun planning and fine-tune the utility models with 5,184 training labels, using 528 validation labels for checkpoint selection and 528 separate test labels.
Table 2. Directional-profile Diffusion planning, JM (%). Statistics follow Table 1; each scene group contains three tasks. Held-out scenes are within training cities, not entirely unseen cities.
The benchmark supports both evaluation under the changed profile and learning with its new labels. Adaptation effects are modest and mixed, so we do not claim configuration-invariant performance. This experiment tests directional elements, not full MIMO, beam optimization or CoMP. Those require explicit array, precoding and coordination policies, and we will state this boundary clearly. The study's value is that these physical assumptions can be varied and their consequences measured within a common planning/evaluation pipeline.