- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SIRUS, a training-free method that removes a target concept from a text-to-video model at inference time. SIRUS projects selected prompt tokens off a subspace built from the concept's aliases and, early in denoising, subtracts a concept-restoring direction estimated from a branch conditioned on retrieved concept prompts. The paper also proposes VUEF, a video-level evaluation protocol that counts a video as failed when enough sampled frames show the target and scores preservation and quality. Experiments cover five safety, object and style concepts on CogVideoX with 200 videos each, against VideoEraser on all five and two further baselines on nudity only. SIRUS reaches 77.5% average forgetting success against 58.0% for VideoEraser, with VBench video quality of 0.808 against 0.778 (0.818 for the unmodified model).
Critical strengths
- The sampling-side correction is effective. Prompt editing alone can leave the concept recoverable from the denoiser's priors, so SIRUS subtracts a restoring direction estimated from a branch conditioned on retrieved concept prompts.
- The forgetting gain over VideoEraser is large and consistent. On 1,000 prompt-matched CogVideoX video pairs, average success is 77.5% against 58.0%, and the gap's 95% confidence interval is 16.0 to 23.0 points (Table 12). SIRUS leads on every concept and every failure threshold of 1 to 16 frames (Table 11).
Critical weaknesses
- The method is never evaluated on prompts without the target concept. When no alias matches and every token's similarity to the concept subspace is below 0.25, the trigger still selects up to three tokens and applies its strongest settings (Tables 21 and 22). The claimed precision on benign prompts is therefore untested, although the paper itself says this case requires checking collateral effects.
- The component ablation is thin and partly inconsistent. It covers only nudity, defines neither the variants nor the sample size, and its full-method success (80.5%) differs from the main nudity result (84.5%, Table 1). Removing the token trigger raises person retention from 78.5% to 81.4% and lowers non-target semantic change (CSDR) from 10.0 to 8.2, so its preservation benefit is unclear (Table 4).
Questions for authors
None.
5 comments
Dear Reviewer kyPN, We are following up on our response to the concerns you raised. We have provided retention results with fallback enabled and disabled, extended the component ablation to the other four concepts, and clarified the separate evaluation batches behind Tables 1 and 4. We also discuss the trigger’s effect on both forgetting and preservation. If you have had a chance to review these additions, we would appreciate hearing whether they address your concerns and which points would benefit from further clarification.
Thank you for the thorough rebuttal and the additional results. I remain concerned about SIRUS's precision and practical usefulness. When other concepts are removed, only 24–26 of the 32 Van Gogh-style videos keep the style, with fallback on or off, which is a real issue in controllable video generation.
Reply to Reviewer kyPN
We appreciate your feedback and respond to the two concerns you raised in W1 and W2.
W1. Retention on unrelated prompts. The soft fallback can intervene even when no alias matches and all token similarities are below 0.25. We generated 50 videos per requested concept with the original CogVideoX. For each of the four other removal targets, we ran SIRUS with fallback on and off using the same prompts and seeds. Each cell gives the counts retained with fallback on / retained with fallback off / present in the original videos. For instance, 39 original videos showed nudity. When SIRUS targeted churches, 34 of those 39 still showed nudity with fallback on and 33 with it off.
On prompts requesting the removal target, we also tested 50 videos per concept. Each cell gives results with fallback on/off.
When the prompt requested the removal target, fallback improved forgetting for all five concepts, yielding 21 more successful removals across 250 videos. When the prompt requested a different concept, the original video showed that concept in 836 comparisons spanning a person’s state, objects, and an artistic style. SIRUS retained the requested concept in 769/836 comparisons (92.0%) with either setting. Enabling fallback therefore improved target removal with no observed drop in overall retention on unrelated prompts.
W2. Ablation batches and the trigger trade-off. Full SIRUS succeeded on 169/200 nudity videos (84.5%) in the main evaluation (Table 1) and on 161/200 (80.5%) in the separate ablation batch (Table 4). Every variant in Table 4 was evaluated on that same 200-video ablation batch.
On the ablation batch, the trigger increased successful removals from 110/200 to 161/200 (55.0% to 80.5%) and reduced frame hit from 34.4% to 15.9%. As you observed, disabling the trigger improved person retention from 78.5% to 81.4% and reduced CSDR from 10.0 to 8.2. Each CSDR value is an average over all 200 cases, including videos in which nudity remained. Simply copying an original video that contains nudity would give both LPIPS and CSDR their ideal value of zero while preserving nudity itself. To assess which variant better preserves other content after removing nudity, the relevant comparison is on matched cases where both variants succeeded.
We extended the ablation to the other four targets using 50 videos per concept.
Across these four targets, the trigger raised mean video forgetting by 24 percentage points (51.5% to 75.5%). Full SIRUS also exceeded the variant without projection (55.0%) and the variant without the reference branch (36.0%). Removing the reference branch caused the largest drop on each of these four targets (34–46 percentage points). The trigger improved forgetting across all five concepts.