- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper performs an analysis-oriented battery of experiments on the dendritic spines of human and mouse neurons. It holds a lot of statistical testing along with a single application concerning Graph Neural Networks and Cross-Attention. The paper presents a negative result on finding no significant evidence on spatial clustering, weak evidence on synaptic morphological similarities between two cases: neighbouring spines and same-spine synaptic target (shared-axon).
Critical strengths
The authors did a great job trying to statistically cover the main questions that affect how spines cluster and morphological similarity. Each part was well founded and the propagation of the idea through the parts is sound. This shows a great deal of understanding how the authors tried to locate a significant finding out of a dendritic study but rather showed that we do not have sufficient evidence.
The authors carried out a lot of experiments with statistical analysis, traditional machine learning and deep learning. Ablations and different settings were present covering additional aspects of the experiments.
Critical weaknesses
Due to the substantially lots of experiments, the paper organization is not easy at all to track. The main paper is very dependent on the supplementary appendix. I found it extremely difficult to track a single experiment, for example Part 1, where you will need to leave the section and go to the start of the appendix to know the model specifics, then go down in the appendix to know the results. This was a prominent issue in every section of the manuscript. I find it also extremely difficult to align the organization of the figures, tables with the appendix organization. Tracing a single piece of information requires great effort.
Some important details are underspecified, for instance:
- In part 1, the held-out evaluation set lacks: how many folds are there, what is the inclusion criteria, the numbers of neurons, branches, spines in each fold.
- In part 1, the analysis lacks a motivation behind the usage of Poison count.
- In part 1, the objective behind spine spatial distribution matters is underdeveloped.
- In part 2, the geometry-only six-knot spline model is explained very shallowly.
- In part 2, a further analysis on the neighbourhood connectivity is crucial in order to determine if the graph architecture is actually a fit choice for the data The lack of these details highly affect the motivation behind main experiments done in the paper.
The paper is highly numeric which is very clear by the big number of tables present. On the other hand, figures do not convey any value except for two figures (Figure 1 and figure S1). Any other figure is actually another view of a table present.
Questions for authors
In part 1, the authors called the two models complementary, I have only seen the branch occupancy as the link between two models. So why is predicting occupancy scientifically important to the objective? Can’t a simple question like predicting the number of spines suffice? And if that is the case, what is the significance of predicting the number of spines to the spatial distribution?
In part 2, for the graph study, does the choice of the graph really captures the essence of the connectivity? Since proximity is the edge contributor in this relationship, we risk having separate disconnected components along the chain. Message passing would stop propagation if the disconnected components are among the chain. A further analysis on the neighbourhood connectivity is crucial.
Why didn’t the authors do multiple morphometric descriptors correction in the correlation shuffling experiment?
In the geometry-only six-knot spline, what anatomical and geometric features were included? A model equation is necessary. Can the authors present a justification on why only 3 out of the 17 morphology descriptors were reported in the study?