- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors claim that a learned measurement operator that maximizes the measurement information for a specific training distribution may not be optimal when the training distribution is mismatched with the true distribution. To analyze this effect, the authors introduce the separation, which quantifies how much variance a measurement operator can capture under unitary rotations of the training distribution. Experiments show that when the true distribution is a rotated version of the original distribution, having a fourth order statistic in the regularizer provides a more robust measurement operator, but under more general distribution shifts the separation-optimal sensor does not show many improvements.
Critical strengths
None
Critical weaknesses
The paper is poorly written and difficult to understand. Several indications, such as unnatural phrasing and overly complex mathematical explanations, give away the fact that it is fully AI generated, with no efforts to improve readability afterwards. Many esoteric concepts such as "Haar twirl" are mentioned briefly, not explained as to why they are relevant, and never brought up again. Other crucial terms like "isotropy" of different orders are not defined until much later and their definition has to be inferred.
The theoretical analysis also focuses on when the true distribution is a rotated version of the training distribution; yet this is essentially never the case in practice. The experiments also demonstrate that when the true distribution has some other distribution shift, the separation does not really help, making the result not so useful in practice.
The fourth order statistics, which is the main contribution as proposed by the authors, also do not provide extra diagnostic information over the second order statistics.
Questions for authors
What is the benefit of using the fourth order statistics rather than the simpler yet equally informative second order statistics, if it doesn't help in practice?