DCVC-RT: Towards Practical Real-Time Neural Video Compression

Description

Project page for DCVC-RT with results and design details — integerized models, implicit temporal modeling — reaching 125/113 fps encode/decode at 1080p with roughly 21% BD-rate gain over VTM.

URL

• Visit resource

Related resources

• AV1 Encoding with libsvtav1 on QencodeThe libsvtav1 encoder (SVT-AV1) is an AV1 implementation tuned for both compression efficiency and parallel performance. This guide covers…
• Open-Source Software Encode/Decode For H.266/VVC ProgressingPhoronix status roundup tracking maturity of the open-source VVC/H.266 ecosystem, including native FFmpeg decoder progress.
• FOSDEM 2024: FFmpeg VVC DecoderFOSDEM Open Media devroom talk on the native in-tree FFmpeg VVC decoder implementation (distinct from wrapping external vvdec).
• FOSDEM 2024: VVdeC<>Arm — Optimizing an Open Source VVC Decoder for Arm ArchitecturesFOSDEM Open Media devroom talk detailing Arm-specific performance optimization work on the open-source VVdeC VVC decoder.
• FOSDEM 2023: VVenC & VVdeC — Open Source Video Encoding and Playback for VVCFOSDEM Open Media devroom talk by Fraunhofer HHI developers presenting the VVenC encoder and VVdeC decoder for the VVC/H.266 codec.
• nano-hevcMinimal educational HEVC encoder written in pure Python, readable-over-fast, for teaching codec internals.
• Differentiable VMAF Re-implementation on PyTorchDifferentiable PyTorch reimplementation of VMAF metric enabling gradient-based codec/RDO optimization, with companion code.
• Performance Comparison of AV1, JEM, VP9, and HEVC EncodersFraunhofer HHI SPIE 2017 paper comparing codec internals, BD-BR, and complexity across AV1, JEM, VP9, and HEVC.
• Opus (xiph/opus)Reference implementation of the Opus audio codec, recently adding deep-learning-based packet loss concealment.
• dav1d.wasmWASM port of the dav1d AV1 decoder, SIMD-optimized with TypeScript interfaces, aimed at production use in browsers.