- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The authors present a supervised, uncertainty-aware instance segmentation model for deep field galaxy detection. Their approach is distinguished by a latent reasoning ansatz which iteratively refines the detection. Based on an uncertainty quantification layer, they propose a human-in-the-loop inspection interface for the model's prediction. The detection performance in terms of precision and recall of the proposed segmentation model is evaluated on two simulated datasets (CSST-Galaxy and CSST-Cluster) as well as the real JWST dataset which is equipped with model-generated pseudo labels (derived from the SExtractor-baseline).
Critical strengths
The approach of integrating a latent reasoning model into a detection framework for deep field detection is interesting and the interactive UQ loop seems like an interesting application for practitioning researchers.
Critical weaknesses
- The paper lacks critical basic components like a related work section positioning the presented approach in the contemporary research landscape. Further, the method description is almost void. See questions Q1, Q2.
- The evaluation protocol does not support the contribution claims: uncertainty quantification is not validated and the interactive loop just reported; see Q3, Q4
Questions for authors
- Q1: How exactly does the model look like, in particular: What are , how is the initial embedding constructed and how many reasoning steps are made? How is the model optimized/trained?
- Q2: Uncertainty quantification is a central property of the presented method but never sufficiently explained: What are and in equation (2)? Why do they capture aleatoric or epistemic uncertainty respectively? Which one is used in the illustrations?
- Q3: If and are predictive uncertainty estimates, they should correlate with model errors or should react to out-of-distribution inputs (in the case of epistemic). How is this addressed by the current evaluation?
- Q4: Why the interactive loop is certainty a valuable application idea, how is the claim (ll 245) that it reduces the need for exhaustive manual review, validated?