- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PGAD-X, based on scientific image segmentation, adds an active dynamic heatmap. The Physical Prefix Encoder (PPE) encodes the description of control laws and scale information, while the Cross Attention Explanation Head (CAEH) generates the heatmap from the shared visual features. The second-stage training aligns this heatmap with the reference image p(x) generated by the rules. The experiments cover three microscopic image datasets and three backbone networks, among which AFM also uses independent expert references and time validation.
Critical strengths
-
Separating the segmented structures from the changing areas is of practical value. Limiting the evaluation to the region where the mechanism is likely to occur is particularly commendable: Table 3 shows that the overall score of the full image may reward the ability to distinguish the foreground from the background, rather than the ability to identify the target activity.
-
AFM provides independent expert reference and time validation. In Table 13, the improvement of PGAD-X over the auxiliary head on SegFormer and SAM2 provides some evidence that goes beyond the fitted training proxy.
Critical weaknesses
-
In Table 6, after using non-scientific text and re-training, the AUC of AFM/SegFormer-B5 was 0.829, the correct description was 0.824, and the additional benefit of accurately describing the correct mechanism was not reflected. The partial time prediction improvement in Table 13 is commendable, but it still needs text ablation to confirm whether it comes from the mechanism semantics.
-
BBBC039 marks the cell nuclei in the top 25% of the single-frame CV ranking as positive, but "high CV" does not equal "CV is increasing". The evaluation of the two biological datasets still follows the training rules, which is insufficient to verify true proliferation or division. Therefore, the relevant explanations in Appendix D should be supplemented with independent evidence or the conclusion should be narrowed.
Questions for authors
-
Can the paired random seeds be used to repeat the text ablation experiment in Table 6, reporting the differences and their uncertainties? Applying the same ablation to Table 13 will also help to verify whether the improvement in time prediction depends on the correct description.
-
What is the basis for Appendix D to interpret the heat map of BBBC039 as a dividing cell nucleus or mitotic index, and to interpret the heat map of LIVECell as proliferation activity? Can these claims be narrowed down to the evaluated proxy targets?
-
D1 requires shared representation, and CAEH meets this requirement. Should the "model fidelity" mentioned throughout the text be understood only in this sense? Formulas 2 and localization scores cannot yet prove the impact of heatmap responses on model decisions.
-
Table 4 has already compared different reading methods at the same first-stage checkpoint. For the complete model comparison in Table 1, if the image intensity scaling is unified and the GradCAM at the second-stage checkpoint is supplemented, what changes will occur in the results of BBBC039? The relevant preprocessing differences can be found in Appendix C.4.
2 comments
Thank you for the author's reply. I'll keep my score.
Thank you for the author's reply. I'll keep my score.
W1/Q1
Thank you. We repeated the ablation with five paired seeds (AFM, SegFormer-B5; Appendix G, Table 14); differences to PGAD-X with 95% CIs:
Neither the static map nor the temporal gain depends on the wording, whereas what the hypothesis specifies does matter: the scale prior, and the hypothesis itself, since a model trained under a different hypothesis follows that hypothesis (diagonal vs. off-diagonal AUC 0.79/0.55 on AFM; Appendix H). We now state this explicitly: the hypothesis enters PGAD-X through its computable terms (reference map, characteristic length, prior type), which also makes the map robust to how an expert or an AI system phrases it.
W2/Q2
The readings in Appendix D rested on the training rule alone, so we added independent evidence and narrowed the claims. On the Cell Tracking Challenge HeLa time-lapse with lineage ground truth (305 divisions within 30 min among 33,357 nuclei; Appendix J), high intra-nuclear CV predicts imminent division (AUC 0.824 at k = 1, 0.600 at k = 4), whereas nuclear area and DNA content predict it inversely (0.254, 0.262). In Appendix M (trained on sequence 01, tested on 02), PGAD-X ranks the nuclei that divide next at anticipation AUC 0.747/0.766/0.720, above PGAD-X-Aux (0.662/0.756/0.619); BBBC039 models applied to HeLa without retraining reach 0.758–0.800. For LIVECell, the "exponential-phase / doubling-time" reading is removed and the map is described as where the stated hypothesis places proliferation; Appendix D now describes the BBBC039 map as the nuclei that the condensation hypothesis selects, citing the HeLa evidence.
Q3
Yes. We renamed the requirement "shared representation" (now D3, Sec. 2.2): H_vis is derived from the same features that produce H_seg, so aligning the explanation acts on, and should preserve, the segmentation, which we treat as a trade-off and evaluate (S1 vs. S2 IoU in Table 1). It is not a claim that H_vis is the causal basis of the segmentation, and the interventions in Appendix I are reported as tests of how the map responds to the input: perturbing the map's own top region changes it more than a random perturbation, on LIVECell this region barely affects the segmentation while the masked region does, and re-initializing the trained weights (Adebayo et al., 2018) drops its AUC to chance (mean 0.515).
Q4
All BBBC039 maps in Table 1 are now computed from the same percentile-scaled input that Stage 2 uses (Appendix L); under it the Stage-1 checkpoint segments at IoU 0.612/0.303/0.514 (0.859/0.879/0.684 under the 16-bit scaling it was trained with). BBBC039 AUC:
On the same Stage-2 checkpoint PGAD-X is higher on 66/66, 66/66 and 64/66 test images (p < 1e-11), and the same holds on AFM against the expert annotation (GradCAM at Stage 2: 0.582/0.687/0.669; PGAD-X: 0.840/0.835/0.833). Stage-2 training therefore does not by itself make a gradient map physics-aligned.