- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper analyzes the latent space of a 3D face model (encoder). More specifically, it decomposes the space using PCA and analyzes the influence of each component on the readability, predictability, and transferability of facial age.
Critical strengths
- Relevance of the Problem: The study of how semantic attributes are encoded and geometrically organized in latent spaces is a topic of great interest to the research community.
Critical weaknesses
-
Failure to distinguish between removing age-specific information and destroying the overall signal
Throughout the manuscript, it is claimed that the drop in the fixed predictor’s performance when directions are removed demonstrates "predictive dependence beyond correlation" and the "functional importance" of those directions. However, the experimental protocol does not demonstrate this. By removing principal or highly correlated dimensions without retraining or evaluating what happens to the rest of the facial information, the entire signal of the representation, not just age, is completely degraded. If the overall signal is destroyed, all the criteria proposed by the authors (a drop in relative to a random control) are trivially met without this implying that a semantic subspace of age has been isolated.
-
Limitations and disclaimers that render contributions meaningless
In the Discussion and Conclusion sections, the article repeatedly emphasizes what its experiments do not demonstrate: that the drop in does not imply that age information has been removed from the residual representation, that the low transfer between runs does not imply that the semantics are different because the coordinates need to be aligned, and that reducing the age prediction does not imply improved identity preservation nor does it demonstrate semantic disentanglement. If the experimental protocol leaves all these fundamental questions open and the observed effects are direct consequences of degrading the signal or of failing to align independent coordinate systems, what does the presented empirical analysis actually contribute or demonstrate?
-
Selection of PCA for the candidate directions
The analysis uses PCA to generate an orthonormal set of candidate directions, which are then ranked based on their absolute correlation with age. Why is PCA specifically chosen to generate the initial candidate directions if the subsequent goal is to search for an association with age?
MINOR
-
Origin of the 3DMM representation
When formulating the problem, it starts directly with a representation derived from 3DMM with 80 dimensions . Where exactly does this representation come from?
-
Model trained and loss functions
When introducing the function loss , where , it is not clear which specific model or modules are being trained using this loss function, nor how each of these terms is mathematically defined.
-
Results charts
Figure 4 shows three panels (, MAE, and “Causal Effect”). The three panels essentially show the same redundant information (especially the first and third, where is simply the same curve as in the first panel shifted by a constant; furthermore, the term “Causal Effect” is used in the figure’s title even though the text explicitly states that claims of causality should be avoided).
-
Comparison with the state of the art
Table 2 ("Comparison with state-of-the-art methods") lists numbers alongside methods such as ArcFace, MagFace, and AdaFace without specifying in the title or in the table headers which metric is being reported or what the exact task being evaluated is. Is this the state-of-the-art for facial recognition measured in verification accuracy (%)?
Questions for authors
The paper’s main methodological problem is that it does not demonstrate that age-related information has been isolated, but rather that the signal is being degraded. To demonstrate that the loss of information is age-specific and not a general degradation of the representation, it is necessary to simultaneously measure the extent to which performance declines in other attributes.