- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses facial expression recognition (FER) under occlusion by proposing OCA3D, an occlusion-cause-aware 3D facial evidence completion framework. OCA3D explicitly models these two sources of missing facial evidence. From each input image, OCA3D predicts an external-occlusion mask and regresses FLAME parameters, based on which a mesh-bound 3D Gaussian representation is constructed over the fixed facial topology. Self-occluded regions are completed through topologydefined bilateral symmetry, while Gaussian attributes for externally occluded regions are recovered from reliable visible mesh faces through nearest-neighbor correspondence within fine-grained semantic regions. The completed representation is rendered from both the input and frontal views, and the resulting evidence is fused with original-image features for FER.
Critical strengths
The method achieves state-of-the-art results across four benchmarks, with particularly impressive gains on pose-variant datasets, which aligns with the method's intended strength in handling self-occlusion.
Critical weaknesses
The paper's positioning statement in the introduction claims that "Existing methods typically address external occlusion and self-occlusion either independently or as generic appearance corruption, without explicitly distinguishing their underlying visibility mechanisms or exploiting cause-specific 3D facial correspondences for evidence recovery." However, this claim overlooks several relevant prior works: 3D facial expression recognition has been studied since at least Soyel & Demirel (ICIAR 2007) [1], which uses 3D facial feature distances for expression classification, demonstrating that 3D geometry has been leveraged for FER well before this work.
3D face inpainting has been addressed by Bai et al. (ICASSP 2023) [2], which proposes fine-grained blind face inpainting using 3D face component disentanglement — directly relevant to the paper's claim of novel 3D evidence recovery. Face inpainting for FER has been explored by Xing et al. (ACM MM 2022) [3], which proposes co-completion of occluded faces specifically for expression recognition, closely aligning with the paper's overall pipeline of inpainting/completing occluded faces followed by FER. The proposed OCA3D method appears to be a combination of ideas from [2] (3D face inpainting/completion) and [3] (FER via face completion), with the cause-aware distinction (external vs. self-occlusion) serving as the main differentiator. The paper should more accurately position itself relative to these works and explicitly discuss what specific design choices go beyond a straightforward combination of prior 3D inpainting + FER methods. The Related Work section should be expanded to include and discuss these references, and the novelty claim should be tempered accordingly. References: [1] Soyel, H., Demirel, H. (2007). Facial Expression Recognition Using 3D Facial Feature Distances. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2007. LNCS, vol 4633. Springer, Berlin, Heidelberg. [2] Bai, Y., He, R., Tan, W., Yan, B., Lin, Y. (2023). Fine-Grained Blind Face Inpainting with 3D Face Component Disentanglement. In ICASSP 2023. [3] Xing, Z., Tan, W., He, R., et al. (2022). Co-Completion for Occluded Facial Expression Recognition. Proceedings of the 30th ACM International Conference on Multimedia.
Questions for authors
The pipeline involves FLAME fitting, 3D Gaussian construction, rendering from two views, and feature fusion — significantly more complex than image-based baselines. The paper does not report inference time, GPU memory usage, or training time. A comparison with baselines on these metrics would help readers assess practical feasibility.
In Figure 3 (qualitative comparison under real-world occlusion), the completion results produced by OCA3D appear overly blurry and lack fine facial details. More importantly, it is difficult to discern whether the completed regions actually convey a "surprise" expression, the facial cues (e.g., raised eyebrows, widened eyes) that would distinguish surprise from other expressions are not clearly rendered. This raises concerns about the visual fidelity and expressiveness of the completed faces, which is particularly problematic for an FER task where subtle expression details are critical. The authors should either improve the sharpness and expressiveness of the completed regions or provide a more rigorous qualitative evaluation protocol (e.g., user studies) to substantiate the visual quality claims.