- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies the impact of isotropy latents on downstream tasks, showing that it comes at the expanse of degrading performance. They also show that matching the task's prior can benefit.
Critical strengths
- Tackle the latent geometry is important task. Especially well studied world models.
Critical weaknesses
-
writing level way below the standard of a top-tier conference. I read the abstract several times and didnt catch almost anything. several examples: 1) using unexplained notations, which I think that should exists in the abstract at all unless they emphasize something - e.g., \lambda, what is it? s_i - what is the i stands for? indexing of what? 2) using vague terms - what cells stands for? what is it a rank of a task? 3) unclear parts: " Theorem A prices a spectrum in labels" - dont understand what is that means. "Under a protocol on 23 encoders and 15 vision and text tasks" - on which protocol are you talking here? 4) The most important things, I've read the abstract several times and cannot tell what is the general purpose of the paper. The low level writing is continue to the intro: "None puts a distribution over the downstream tasks. This paper does. Put a prior w ∼ (0, P) on the linear read-outs a representation will be asked for." - what is "put distribution" means?
-
You are using notations without first declare them - lines 45-46 - what are and ? what does in line 48 means?
Questions for authors
In the abstract you wrote Theorom A (line 19) and in the intro you write Theorom 1 (lines 45-46). are they both the same? If they dont then why do you have two metrics for numbering? because two lines after you are referring to Theorom A.
-
line 84 - "isotropising" - I dont think it is a valid word in English.
-
Where is the Conclusions section? I think it is important to summarize such paper.
-
Think that with respect to whitening, this paper is relevant here [1].
I think that even if the paper is super smart and tackle useful task, myself - as a human - cannot catch the idea since it is too involved with inaccurate English, non coherent logical flow, heavy mathematical derivation without explanations. Definitions and notations should first introduced then used, you should add some intuition for derivations. thus, even after trying hard, reading the abstract and intro several times, trying to follow the Theory part I am still more confused than learned. So sorry but I think that the paper should be rewritten aggressively in a more understandable way, and then be submitted again.
refs:
[1] Whitened CLIP as a Likelihood Surrogate of Images and Captions. Betser et al. ICML 25