- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TCFlow, a framework for single-reference video color transfer that aims to achieve accurate color matching while maintaining temporal consistency. The key idea is to replace frame-wise color transformations with a clip-shared rectified flow, which maps the aggregated video color distribution to a common latent space and then transfers it to the reference color distribution. The method further introduces a color aggregator to predict the shared flow parameters efficiently without test-time optimization. Experiments on DL3DV-10K and a real-world media art dataset demonstrate improvements in color fidelity, structural preservation, and temporal stability compared with existing methods. Ablation studies further investigate the effectiveness of the clip-shared flow and color aggregation module.
Critical strengths
None
Critical weaknesses
None
Questions for authors
-
Novelty: How does TCFlow differ fundamentally from ModFlows? Would simply applying a shared flow to temporally pooled video colors achieve similar results?
-
Temporal consistency: The proposed flickering metrics rely on frame-wise color histogram differences, which may be affected by motion and occlusion. Could the authors provide motion-compensated evaluations to better validate temporal consistency?
-
Color Aggregator: Table 2 shows that the aggregator improves color fidelity but worsens temporal consistency and Lipschitz scores. How do the authors justify this trade-off?
-
Theoretical formulation: How can a single invertible flow map different frame-level color distributions to the same latent distribution? Is the alignment only guaranteed for the aggregated video distribution?
2 comments
Response to Reviewer bSaQ (2)
[Q3: Color Aggregator]
The Color Aggregator improves reference color fidelity, although it introduces trade-offs in certain numerical metrics, including depth, edge and Lipschitz scores. To further investigate temporal stability, we introduce a motion-aligned, reference-weighted metric , which evaluates color consistency along corresponding scene points while accounting for occlusions and reference color alignment. Unlike histogram-based temporal metrics, this composite metric combines motion-aligned color stability with reference color fidelity. Notably, the full TCFlow improves this metric from 0.9585 to 0.8475 compared with the variant without the Color Aggregator (see Table 2).
We further examine the perceptual quality of TCFlow through a user study with 23 participants (see Appendix A.8). All participants evaluated the same 19 media art video sequences, comparing ModFlows, VideoColorGrading, ColorFM, and TCFlow based on overall perceptual quality, considering both reference color fidelity and temporal stability.
TCFlow received 54.5% of all preferences, outperforming ModFlows (21.1%), ColorFM (18.3%), and VideoColorGrading (6.2%). The overall preference differences were statistically significant (Friedman test: ). These results suggest that the trade-offs observed in individual numerical metrics do not necessarily translate into lower perceived video quality. The motion-aligned evaluation and user study provide complementary evidence of TCFlow's improved performance under the proposed reference-weighted metric and higher perceptual preference.
[Q4: Theoretical formulation]
TCFlow shares a mapping across frames within each clip, while targeting the pooled clip distribution for alignment. A single invertible map cannot push distinct frame distributions to exactly the same latent distribution; this is not a requirement of our training formulation.
Specifically, Eq. (3) defines the balanced clip distribution as . Writing , the revised Section 3.3 explicitly states
The individual transformed frame distributions may differ; their mixture is the distribution targeted toward . This formulation matches the existing teacher objective in Eq. (8), which samples colors from the pooled clip distribution, and its subsequent distillation in Eq. (9).
For idealized exact population-level alignment, if and , where is invertible, then .
This implication concerns the pooled distribution and does not establish alignment of every frame individually. In practice, these are approximate learning targets rather than unconditional guarantees.
We have also clarified in Section 3.1 that Eq. (1) expresses an empirically evaluated frame-wise color-fidelity criterion. These revisions make the scope of the formulation explicit while retaining the existing training and inference procedures.
Response to Reviewer bSaQ (1)
[Q1: Novelty]
TCFlow differs from ModFlows in two key aspects. First, while ModFlows estimates frame-wise color transport mappings, TCFlow formulates transport over a temporally pooled clip-level color distribution and applies a shared mapping across all frames. Second, TCFlow introduces a learnable Color Aggregator that integrates temporal color information to estimate video-level flow parameters, going beyond simple temporal pooling.
The contribution of the learned aggregation is demonstrated by the TCFlow w/o Color Aggregator ablation in Table 2. This baseline uses mean aggregation over the clip-level color distribution without a learned Color Aggregator. Compared with this baseline, the full TCFlow reduces SWD from 0.0599 to 0.0462 and MS-SWD from 1.6606 to 1.2355, while also improving reference-weighted track-color flicker ΔEtrackref from 0.9585 to 0.8475. These results show that mean aggregation over clip-level color distributions alone does not fully capture the benefits of TCFlow; learned temporal aggregation further improves reference color alignment and temporal consistency.
We have revised the Introduction to better motivate the need for balancing reference-color fidelity and temporal consistency (see Lines 047-079), and clarified the contribution of learned temporal aggregation in the ablation study.
[Q2: Motion-Compensated Temporal Consistency]
We supplement the histogram-based temporal metrics with a motion-aligned evaluation to assess color stability along corresponding scene points while accounting for occlusions. Specifically, we use CoTracker3 [1] to extract point trajectories and visibility masks from the original input videos, ensuring that all methods are evaluated using identical correspondences. We first define ΔEtrack to measure temporal changes in color-transfer residuals along valid tracks in CIELAB space. We further incorporate reference color fidelity through a relative SWD weighting, defining a composite metric, ΔEtrackref, that jointly reflects track-based color flicker and reference color distribution alignment. The results are summarized below:
TCFlow achieves the lowest ΔEtrackref across all four benchmarks: DL3DV-10K (0.8475), Media Art (0.6586), REDS (0.9262), and MOSE-v2 (0.1855). These results demonstrate that TCFlow consistently outperforms competing methods in both motion-aligned temporal stability and reference color alignment. We have added the motion-aligned evaluation, metric formulations, and implementation details to the revised paper (see Appendix A.4 and Tables 1, 7, 8 and 9).
Reference
[1] CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. ICCV 2025.