- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes JRCC (Joint Residue and Conditional Coding) for overfitted neural video compression. The central idea is to retain the explicit prediction-residue structure of residue coding while injecting motion-aligned temporal features into residue synthesis. The authors argue that directly applying conditional coding to overfitted codecs is inefficient because the decoder parameters themselves must be transmitted, making increased conditional-model capacity costly. JRCC therefore reuses already decoded motion information to align reference-frame features and conditions the residue synthesis network on these temporal features. Experiments under both random-access and low-delay configurations report average BD-rate reductions of 9.7% and 27.8%, respectively, over Cool-Chic 4.1.
Critical strengths
-
In the overfitted setting, frame-specific decoder parameters contribute directly to bitrate, so simply increasing conditional decoder capacity is indeed undesirable.
-
JRCC reuses decoded motion for feature alignment instead of estimating a second motion field, and the temporal-conditioning path is intentionally lightweight.
Critical weaknesses
-
JRCC mainly augments the existing Cool-Chic 4.1 residue-coding framework with a motion-aligned temporal feature-conditioning branch and feeds the resulting temporal features into residue synthesis. While this design is intuitive and effective, the individual operations, including feature extraction, motion warping, feature fusion, gated refinement, and concatenation-based conditioning, are relatively standard. The paper would benefit from stronger comparisons against simpler alternatives such as warped-reference concatenation, feature modulation, additive conditioning, or lightweight attention-based conditioning to better establish that the proposed “joint residue and conditional coding” formulation provides a distinct methodological contribution.
-
JRCC includes its frame-specific model parameters in the transmitted bitrate, whereas offline-trained neural codecs such as DCVC-B and DCVC-FM exclude pretrained model parameters from bitrate. Although this difference reflects the underlying coding paradigms, it makes direct comparison less straightforward. In addition, Table 1 shows that JRCC still underperforms VTM-24.0 and the learned conditional codecs in several settings. The most convincing evidence is therefore that JRCC improves the directly comparable Cool-Chic 4.1 overfitted baseline, rather than that it is broadly superior to modern video codecs. More comparisons with recent overfitted neural codecs would strengthen the empirical positioning.
-
JRCC increases decoding complexity from 831.3 to 1231.1 MACs/pixel, corresponding to roughly a 48% increase, despite being repeatedly described as lightweight and compact. The paper does not report actual decoding latency, encoding/optimization time, memory consumption, or the proportion of bitrate contributed by the additional conditioning parameters. Since compactness and transmitted model cost are central motivations of the work, a more complete rate–distortion–complexity analysis is necessary.
-
Evaluation is restricted to the first 33 frames of HEVC Classes A, B, E and UVG, following prior Cool-Chic settings. This leaves several important questions unanswered, including long-sequence error propagation, robustness to scene changes and high-motion content, and behavior under longer temporal dependencies. The ablation study also does not isolate several important design choices, such as motion alignment itself, reuse of the pixel-domain blending map for feature fusion, conditioning of the residue versus the prediction-weight map, or alternative feature-fusion strategies. In addition, the much larger gain under LD than RA deserves deeper analysis rather than only being reported numerically.
-
The paper argues that conditional coding is less suitable for overfitted compression, but the evidence only demonstrates this for the specific conditional architecture and capacity-scaling strategy evaluated here. More parameter-efficient conditional designs may behave differently, so the broader claim should be weakened. In addition, the rate–distortion objective in Eq. (8) explicitly includes motion and residue rates but not a model-rate term, even though transmitted frame-specific network parameters are central to the paper’s motivation and are counted in the final bitrate.
Questions for authors
How do the authors distinguish the proposed JRCC from a conventional residue-coding framework augmented with an additional temporal feature-conditioning branch?
Since JRCC still underperforms some offline-trained codecs such as VTM-24.0, DCVC-B, and DCVC-FM in several settings, how should readers interpret the intended scope of the method?
JRCC increases decoding complexity from 831.3 to 1231.1 MACs/pixel. Could the authors report practical encoding time, decoding latency, memory consumption, and the additional model-bit overhead introduced by the temporal-conditioning modules?