- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces PixelSmile, a method for fine-grained facial expression editing that preserves identity. The authors build FFE, a dataset of approximately 60,000 real and anime images covering 12 expressions, with continuous intensity annotations generated by multimodal models. PixelSmile fine-tunes Qwen-Image-Edit with symmetric expression-separation and identity-preservation constraints, and controlling expression intensity through text-embedding interpolation.
Critical strengths
The authors show that similar expressions are often confused and train the model to separate them. Ablation studies confirm that this helps reduce confusion.
Existing datasets either lack multiple expressions of the same identity or use only three intensity levels. FFE provides continuous intensity scores for both real and anime faces, with multiple expressions of the same identity.
Critical weaknesses
Gemini 3 Pro is used for both training labels and evaluation, so the results may not reflect actual improvements in expression editing.
FFE is generated using Nano Banana Pro, which is also a main baseline. PixelSmile’s gains over it may come from better prompts and data filtering rather than the proposed method.
Human validation checks only the reliability of intensity scores. The user study compares just three methods on smoothness and identity preservation, without independently validating expression confusion or editing accuracy.
The continuous-control baselines (SliderEdit and K-Slider) use FLUX.1 Kontext, while PixelSmile uses Qwen-Image-Edit. This makes it hard to tell whether the gains come from the method or the base model.
The paper does not specify whether baselines use equally detailed prompts. The authors also note that Nano Banana Pro produces vague edits when given only expression names.
Questions for authors
see Critical Weaknesses
The anime domain is evaluated only through visual examples, with no quantitative results. Can the authors provide numerical evaluations? Since the anime model does not use an identity constraint, how is identity preservation measured?
Will the dataset and code be released? The anime data comes from 207 commercial works. How will copyright issues be handled upon release?
3 comments
Kindly request for response
Dear Reviewer wjnZ,
Thank you again for your detailed feedback. We would like to draw your attention to the following points in our rebuttal:
- Evaluation reliability: Appendix H adds independent human annotations and two additional VLM evaluators, with a consistent method ordering on Acc-6 and mSCR. Fig. 17 examines the larger variation in NBP accuracy.
- Training versus data and base-model effects: we highlight the existing fixed-data component ablations and comparisons using the same Qwen base, which isolate the gains from our training. We also clarify that all methods receive the same simple expression-prompt template during evaluation.
- Anime evaluation and data release: our response explains the identity supervision, the limitations of anime quantitative evaluation, and the release plan with source-specific redistribution conditions.
We would appreciate your thoughts on whether these responses address your concerns, and would be happy to clarify any remaining questions.
Best regards,
The authors
Final follow-up before the discussion deadline
Dear Reviewer wjnZ,
As the discussion period closes in approximately three hours, we would appreciate hearing whether our responses on evaluation reliability, the contribution of training, and the other points you raised have addressed your concerns. Please let us know if anything remains unclear so that we can respond before the deadline.
Thank you again for your careful review and time.
Response to Reviewer wjnZ
Thank you for recognizing the design that separates similar expressions and its ablation validation, and the value of FFE's continuous intensity annotations. We address your points below.
📝 W1 / W3: Evaluation independence and human validation.
💡A: Regarding evaluation independence, we add human category annotations and evaluation with GPT-6 Astra and Claude Opus 5.5, directly validating editing accuracy and structural confusion. Human annotations and the three VLMs give a consistent method ordering on Acc-6 and mSCR. The protocol, results, and analysis are in the general response and
Appendix H.📝 W2: Training data versus training method.
💡A: We agree that high-quality training data contributes substantially, but ablations show that the data alone is not enough to resolve expression confusion. Keeping the same training data and removing the contrastive loss gives Acc-6 of 0.6471 and mSCR of 0.2725, versus 0.8627 and 0.0550 for the full model. Thus, even with carefully prompted and filtered data, the model still cannot reliably separate similar expressions without our training constraints. Data quality and the training method jointly produce the improvement, and the fixed-data ablation directly supports the method's contribution.
The dataset's value is also supported by an ablation: with the same architecture and optimization settings, training on MEAD gives Acc-6 of 0.7647 and mSCR of 0.2125, while training on FFE gives 0.8627 and 0.0550. This supports FFE's training value, and the fixed-FFE component ablation shows our training method is essential.
📝 W4: Base model differences.
💡A: We acknowledge Qwen and FLUX differ in base capability, and Qwen's stronger editing ability gives a good start. Qwen with the control module already shows some linear control, and our training improves it. We therefore compare the same Qwen base before and after training to separate the base model's existing ability from our training's gains. Comparisons across base models reflect the full system, while the same-base-model and component ablations support our training.
📝 W5: Are the evaluation prompts equally detailed?
💡A: We clarify the difference between training-data construction and evaluation. During training-data construction we use detailed local facial descriptions to improve the semantic accuracy of generated expressions. During evaluation, all models use the same simple template that only specifies the target expression word, without extra facial or action descriptions. PixelSmile therefore receives no more detailed prompts than the baselines at test time, and NBP is evaluated under the same unified condition.
📝 Q1: Anime identity preservation and quantitative evaluation.
💡A: Anime and real faces are identified differently. Real identity relies on fine facial features, while anime characters are highly simplified and can be recognized from a few semantic elements such as silhouette, signature hat, or hairstyle. We therefore believe the CLIP feature supervision used in training is sufficient to constrain these identity-bearing semantic elements and support anime identity preservation, without introducing an additional real-face identity loss. DanbooruCLIP only adapts the features to the anime domain.
For anime quantitative evaluation, we observe that existing methods produce stable edits only on a few expression categories, with large variation on complex expressions. Our method improves on most anime expressions after training, but instability remains. Meanwhile, VLM recognition of complex anime expressions is not reliable enough to separate editing failures from evaluation errors. We therefore cannot yet give a reliable quantitative method comparison for anime, and the anime results mainly demonstrate the method's applicability and current capability.
📝 Q2 / Ethics: Release plan and data sources.
💡A: Data sources and usage are already described in the paper's
Ethics statement, Data Sources and Usage paragraph: all data are collected from public sources and used under their respective licenses, with the real subset from two MIT-licensed datasets and the anime subset of fictional characters from public productions. We add our release plan here: we will release the code, the data construction pipeline, and the annotations; images that may be redistributed will follow their original licenses and retain source information; images whose redistribution rights are unclear will be provided as a source index with annotations, without distributing the image files; and for the real people and commercial anime characters shown in the paper, we will verify their use and replace or remove examples without confirmed permission.