- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
The paper studies zero-filled PLS-SVD under MCAR missingness in a rank-one regression model with a column-orthogonal design. It derives the recovery threshold and singular-vector overlaps, and shows that missing design entries can cause a persistent recovery ceiling even when the signal becomes very strong. Simulations and semi-synthetic experiments on biological data are provided to examine these theoretical predictions. The manuscript and appendix together contain 73 pages, and I have not independently verified every theoretical statement and proof. Based on my overall reading, the main theoretical arguments appear reasonable.
Critical strengths
- The paper explains the different effects of missingness in the two views. Under the stated assumptions, missing response entries mainly weaken the signal, while missing design entries can cause a recovery ceiling even at high signal strength. This provides useful understanding of why stronger signals cannot always remove the design-side estimation error.
- The theoretical predictions are examined through simulations with different signal strengths, retention rates and sample sizes, together with semi-synthetic experiments on biological designs. These results provide useful support for the recovery curves and direction-specific ceilings within the studied model.
Critical weaknesses
- The theory is limited to a rank-one signal. Although eight biological directions are examined, each is planted and evaluated separately. This does not establish recovery when multiple shared factors coexist or interact. A rank-k analysis is still missing, which limits the breadth of the theoretical contribution.
- The practical applicability is not sufficiently demonstrated. The theory assumes homogeneous MCAR missingness and whitening before masking, while the biological experiments use synthetic responses and artificial MCAR masks. These experiments support the specified model, but provide limited evidence for naturally incomplete multimodal data.
Questions for authors
- Which parts of the analysis can extend to a rank-k signal, and which key steps specifically require the rank-one assumption?
- How can the direction-specific ceiling be used in practice when complete-data whitening and the true signal directions are unavailable?
- How does the Hadamard column-selection procedure in the code satisfy the nested-design condition of Corollary 3.6?
5 comments
Thank you for the response and revision. The corrected Hadamard experiments and additional analyses strengthen the paper. However, (1) whitening from incomplete data remains unresolved, with recovery changing by 0.08–0.15 across the tested eigenvalue cutoffs; (2) the added experiments still use synthetic responses and controlled missingness, so validation on naturally incomplete data is still missing. These practical limitations and the incomplete rank-k theory restrict the scope of the contribution. I maintain my score of 3.
Thank you for the follow-up. We are glad that the corrected experiments and the new analyses helped and we agree with the limitations you list. On whitening, the loss comes from the smaller of the two cutoffs. At the larger one the overlap is at most 0.04 below what the complete-data whitener gives, but we have no rule for choosing the cutoff from the incomplete data, so this is open as you say. Incomplete data and a theorem for several components are also open and Appendix M lists all three. Some parts of the analysis hold for several components, and we will add a short paragraph to Section 4 so the main text reflects that.
Thank you for the careful review. Your Q3 caught an error in our code that we had missed. The figures and the text are corrected in the revision (changes in blue).
W1 and Q1. Rank one, and what extends to several components
You are right that the theory covers a single component and that the biological directions were planted one at a time. We do not have a theorem for several components. The new Appendix L.1 works out what carries over and tests two components planted together.
The high-signal results carry over. The decomposition in Proposition 3.1 is linear in the signal, so it holds exactly for each component. The geometry behind the ceiling (Proposition C.3) extends as well and brings in one new quantity, a cross coupling that measures how much the scores of two components share high-leverage samples. From these two results we compute the overlaps of all components at high signal. Under equal leverage the cross coupling vanishes, and components of distinct strengths each reach the same ceiling as when planted alone. A nonzero cross coupling mixes the components and changes their ceilings. In Table 4 the formula predicts design-side overlaps of 0.63 and 0.70, which is what we measure. Each component alone would reach 0.74. This is a computation and not a theorem, because we have not extended the perturbation argument behind Theorem 3.3.
Theorem 3.4, the finite-signal result, does need rank one, at two steps of its proof. The exact rank-one identity behind the threshold (Appendix E.6) gains terms between different components, and our spectral condition (Assumption E.10) gives no limits for them. The argument below the threshold (Appendix F.7) controls one component only. So for finite signal we report simulations under equal leverage (Table 5). Two components of distinct strengths each follow their own rank-one curve within about 0.01, and with equal strengths only their span is recovered.
On TCGA we planted the two leading directions together at high signal. With the response fully observed, each is recovered within 0.01 of its value when planted alone. With 30% of the response entries missing, the weaker one loses 0.08.
W2 and Q2. Using the results outside the model's assumptions
For the assumptions (new Appendix L.3, Table 7), we simulated masks whose retention differs across samples or features or depends on the value, and whitening applied after masking. The computation behind the ceiling, with a retention for each entry, predicts the high-signal design-side overlap within 0.02 in every setting. The assumptions do matter for the formula in the paper. At the mean retention it can be off by up to 0.45 when the design retention differs across features or depends on the value. The extension is a computation for the high-signal limit, not a theorem.
The true direction is no longer needed. The ceiling depends on it only through each sample's score along it, and these scores can be estimated from the response. With each sample's leverage estimated from its observed design entries, the new estimate of the ceiling uses only the masked data (Section 4, Appendix L.2). On the eight leading TCGA directions its mean over trials is within 0.005 of the true ceiling at high signal.
The estimate still assumes a design whitened before masking, which cannot be checked from the incomplete data. When we instead estimate the whitening from the masked data, recovery depends on where the small eigenvalues are cut off (Appendix L.3), so this remains open.
Naturally incomplete data also remain untested, because the true direction is then unknown. We tried the method on a real response from TCGA with an inconclusive result, described in our response to Reviewer TTS6 (Q1).
Q3. The Hadamard column selection in the code and the nested-design condition
The column selection in the code does not satisfy the condition. Corollary 3.6 covers the first Dx columns of the Sylvester matrix, up to signed permutations of rows and columns, while the released code draws Dx columns at random, which is in general a different design, and the submitted Appendix I.2 wrongly said that the corollary allows this. Figures 1(a) and 2 were therefore run on a design outside the verified class.
We re-ran both figures on the correct design, and the conclusions do not change. In Figure 1(a) the measured curves differ from the submitted ones by at most 0.012. In Figure 2 the values of Rx2 differ by at most 0.043.
We have corrected the text in Appendix J.1 (I.2 in the submission) and at the end of Appendix G. The mistake concerns only the simulations behind these two figures, so no theorem or proof is affected.
We are happy to clarify anything further during the discussion, and we would be grateful if you would consider raising your score.