- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This work focuses on localized video stylization and introduces a new dataset, LociArt-100K, which contains 100,000 pairs of localized stylization data. The authors also present the LociArt Benchmark—comprising 80 source videos and 84 target masks—and propose a new evaluation metric called "Style Prototype Similarity" (SPS). Based on these, the authors introduce a unified framework, LociArt. Building upon the existing Generative Refinement Network, the framework incorporates a "polar style-aware mask" and a "representation-geometry condition," enabling the integration of spatiotemporal context with geometric control.
Critical strengths
- The scope of the work is substantial; it introduces a dataset, a benchmark, and an evaluation metric, while also improving upon existing methods.
- The dataset, as showcased on the website, appears to be of high quality.
Critical weaknesses
- Although the method significantly outperforms existing approaches in terms of quantitative metrics, the visual quality of the results remains somewhat coarse.
- The video examples provided on the anonymous website—both in the dataset and those generated by the method—exhibit very limited motion; in particular, the overall movement within the frames is minimal. It is unclear whether the method faces limitations when applied to scenarios with more significant motion. The authors are encouraged to provide additional examples that demonstrate the boundaries of the method's capabilities.
- The paper does not showcase longer sequences; it appears the method is currently limited to generating clips of approximately 3 seconds in duration.
- In the ablation study (Table 2), the "RG" (representation-geometry condition) and "polar encoding" components yield only marginal improvements in the SPS and CLIPT metrics, with only the RG component showing a notable impact on PSNR. It is worth questioning whether the polar encoding is truly necessary.
Questions for authors
See weaknesses
Response to Reviewer ZJfd
We thank the reviewer for recognizing the scope of our contribution and the quality of the dataset. We address the four concerns below, with additional motion examples and mask-robustness results.
1. Visual quality and comparison with existing methods
Our visual evaluation considers both regional style expression and preservation of non-target content. The full SOTA video comparisons show stronger local stylization while preserving non-target content, rather than merely achieving higher numerical scores. For example, GRNStyle applies pixel-art stylization to the dog while preserving the armchair and room. These videos make the qualitative difference directly inspectable during playback. Some results remain imperfect, particularly around fast-moving boundaries, as already discussed in the limitations section.
2. Motion range and additional continuous videos
The original version of our anonymous page already includes appreciable motion, such as the first swinging example under Claymation and the first horse-riding example under Oil Painting. Importantly, the SOTA comparison videos retain all frames but are played at 16 fps instead of 24 fps, making playback two-thirds of the original speed. This presentation choice makes motion appear slower; it does not indicate that the underlying sequences contain only small movements. We have clarified this playback setting on the page.
We have also added 10 additional examples with substantial motion, covering five foreground and five background edits, with synchronized source, mask, and output videos. Most of the displayed examples retain coherent local stylization and preserve non-target content, although rapid motion can still affect quality and boundary stability. They provide direct video evidence beyond the limited-motion examples, while also making the remaining limitations visible.
3. Video duration and scope
Our focus is stylization quality and local region–style control, not extending the temporal horizon of the underlying generator. Our inference frame count and duration follow the backbone, whose temporal capacity determines the supported video length. The proposed region–style conditioning does not impose a separate temporal window and is, in principle, compatible with the backbone’s longer-video generation strategies. Extending the backbone’s temporal horizon is therefore orthogonal to our contribution and outside the scope of this work.
4. Complementary roles of RG and Polar
RG primarily improves spatial preservation, which is a central objective of local editing: adding RG increases PSNR from 20.09 to 25.07 dB without materially changing stylization scores.
Polar serves two complementary purposes: improving stylization on top of RG and supporting replay-free style expansion. First, adding Polar to RG increases SPS from 0.544 to 0.554, while also improving PSNR from 25.07 to 25.78 dB. Second, it supports learning additional styles without replaying the original training data, while better retaining previously learned styles, as discussed in Sec. 5.5. In expansion from 10 to 15 styles, training uses only the five new classes: the old-class SPS drop is 0.022 with Polar versus 0.102 with binary masks, and the CLIP-T drops are 0.008 versus 0.019. These results demonstrate benefits in both stylization quality and replay-free extensibility.
Additional robustness evidence. As complementary evidence of practical local control, the added appendix Section G “Robustness to Imperfect Masks” evaluates five perturbation types at two severity levels, with 400 video–style evaluations per variant. Under light boundary noise, dilation, erosion, and temporal jitter, SPS and CLIP-T changes remain within 0.006 and PSNR changes within 0.49 dB. Light frame dropout causes a larger background SPS decrease of 0.022, while stronger perturbations expose further degradation. These results demonstrate that GRNStyle, with its complementary RG and Polar conditioning, maintains robust local stylization under moderate mask inaccuracies.