- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the reliability of seismic phase picking, focusing on the small fraction of large arrival-time errors. It proposes SeisTailFlow, a tail-aware conditional flow model that uses cross-fitted, out-of-sample residuals to identify high-error training cases. The framework combines shared waveform encoding, background-referenced spectral enhancement, Main and Tail conditional flows, GPD exceedance modeling, and adaptive vector-field fusion. Arrival time is represented as a waveform-dependent location plus a stochastic residual. The fused flow generates arrival-time samples, whose mean provides the point prediction and whose distribution provides predictive intervals. The paper reports improvements on synthetic waveforms and STEAD in overall accuracy, tail errors, low-SNR performance, and probabilistic prediction quality, and includes ablations and stratified analyses.
Critical strengths
-
The paper addresses large arrival-time errors that may affect downstream phase association and localization. The use of tail-risk and probabilistic metrics provides a more comprehensive evaluation than MAE alone.
-
Event-level data splitting, training-only normalization, and out-of-fold tail-label construction help reduce data leakage. The controlled synthetic experiments further support the analysis of different factors affecting performance.
Critical weaknesses
-
Tail metrics raise consistency concerns. The P99, ES@99, and [email protected] values in Table 1 appear difficult to reconcile with Eqs. (53)-(55); the full model's Tail MAE also differs between Table 1 and Tables 6/7. How are these discrepancies explained, and are the same evaluation thresholds used across these tables?
-
Tail Flow training is insufficiently specified. How are the final model's target states z_1^main and z_1^tail constructed, including any normalization and gradient detachment? How are high-error samples used in Tail Flow matching?
-
Unclear ablation configurations limit interpretation of the results. How do "w/o Tail Flow" and "Main Flow only" differ in retained modules, auxiliary losses, and generation steps?
Questions for authors
-
Please provide per-run P99, ES@99, and [email protected] for Table 1, together with the quantile conventions, units, percentage conversion, and aggregation procedure. Are all three computed from the same absolute errors within each run?
-
What numerical evaluation threshold and selection rule are used for Tail MAE in Table 1 and Tables 6/7? Do these tables use the same threshold, underlying test predictions, and aggregation procedure? Please reconcile the full model's values of 0.0268 s and 0.0152 s.
-
For the final dual-flow model, what are the exact formulas for the Main and Tail target states, including any normalization? Does Tail Flow matching select or reweight high-error cases? Is the location prediction detached when constructing these targets?
-
Which modules, auxiliary losses, and generation steps are retained in 'w/o Tail Flow' versus 'Main Flow only'?
5 comments
Gentle Follow-up on Our Rebuttal
We sincerely appreciate your insightful comments. We have carefully addressed your concerns and submitted our rebuttal. We would be grateful if you could take a moment to review our responses and share any further comments. Thank you so much for your valuable time and consideration.
Second Follow-up on Our Rebuttal
I am following up once more on the rebuttal we submitted. We greatly appreciate the reviewer. Please let us know if any further information would be helpful. Thank you very much for your kind attention.
We sincerely appreiciate the valuable comments from the reviewer.
W1 seeQ1 & Q2.
W2 see Q3.
W3 see Q4.
Q1 To ensure a fair comparison between SeisTailFlow and the baselines under the same computational time budget, Table 1 uses the SeisTailFlow configuration with a fixed fusion weight of α=0.1. In the verified run, P99 and ES@99 are both computed from the same set of absolute arrival-time errors measured in seconds: P99 is the empirical 99th percentile calculated using linear interpolation, and ES@99 is the mean absolute error exceeding that percentile. [email protected] is defined as the proportion of samples with errors exceeding 0.3 s, multiplied by 100. Our experimental results are based on multi-seed evaluations: each metric is first calculated within each run, and its mean and standard deviation are then aggregated across runs, rather than being calculated directly in a single step. Our reported tail metrics are consistent with Eqs. (53)–(55). The ablation experiments use adaptive routing and therefore correspond to a different model configuration from Table 1.
Q2 Tail MAE is the mean absolute error above a predefined evaluation threshold ueval. This metric uses the training-set OOF tail-screening threshold:
\mathrm{MAE}_{S}=\frac{1}{|S|}\sum_{i\in S}e_{i}^{\mathrm{adaptive}}.$$ The adaptive model can predict samples identified as difficult by Seis Main more accurately; therefore, its mean error can be 0.0152 s, below the screening threshold. The same quantile threshold is used across all models. The ablation results were obtained by retraining the models. Due to randomness in the training process, training durations varied slightly; training in the ablation experiments was longer and achieved somewhat better convergence. **Q3** We do not separately normalize the Main and Tail Flow outputs before combining them. Instead, we adaptively fuse their vector fields and normalize the fused result. This is also one of our innovations, and this treatment can improve predictive accuracy. $$v_{\mathrm{fused}}(z_{t},t\mid\mathbf{X})=\rho_{t}\\,v_{\mathrm{main}}(z_{t},t\mid\mathbf{h}_{\mathrm{main}})+(1-\rho_{t})\\,v_{\mathrm{tail}}(z_{t},t\mid\mathbf{h}_{\mathrm{tail}}).$$ Both the Tail and Main Flows are trained on all samples, with additional weights assigned to tail and non-tail samples to strengthen their respective training, as follows: $$L_{\mathrm{FM}}=\underbrace{\frac{1}{|B|}\sum_{i\in B}\ell_{i}^{\mathrm{fused}}}_{\text{All samples}}+\underbrace{\frac{\beta}{\max(|B_{0}|,1)}\sum_{i\in B_{0}}\ell_{i}^{\mathrm{main}}}_{\text{Non-tail samples}}+\underbrace{\frac{1-\beta}{\max(|B_{1}|,1)}\sum_{i\in B_{1}}\ell_{i}^{\mathrm{tail}}}_{\text{Tail samples}}.$$ As shown by the formula, the quantile properties of the Tail and Main Flows are preserved. The location prediction is not detached when constructing the target states; therefore, the prediction targets remain connected to the location prediction. **Q4** We apologize for the ambiguity caused by our naming and will provide additional clarification in the manuscript. **Main Flow only** is a single-flow model that retains only the shared waveform encoder, Main branch, and location prediction head. It uses only time-domain conditioning representations and is trained with the Main FM loss and location NLL. During generation, only the Main vector field is integrated. **w/o Tail Flow** is a single-flow ablation model that retains the spectral-enhancement module: spectral features are fused with the Main conditioning representation and supplied to a single Main vector field, while the Tail vector field, routing module, and associated BCE and GPD training terms are removed. Training retains the Main FM loss and location NLL, and FM gradients can update the spectral encoder through the enhanced conditioning. During generation, only the Main vector field is integrated, but it uses both time-domain and spectral information. **We have thoroughly revised the manuscript in response to the reviewer's insightful comments and uploaded the updated version.** We have added a table note to Table 8 (P32) and highlighted it in color. **We sincerely appreciate the reviewer for your great efforts, valuable time and insightful comments for our paper.**