The Practice of Averaging Rate-Distortion Curves over Testsets to Compare Learned Video Codecs Can Cause Misleading Conclusions

Description

2024 peer-reviewed paper analyzing codec benchmarking methodology, specifically BD-rate averaging and evaluation best practices for comparing codecs.

URL

• Visit resource

Related resources

• SR+Codec: a Benchmark of Super-Resolution for Video Compression Bitrate Reduction2023 peer-reviewed benchmark paper analyzing bitrate savings (up to 65%) through super-resolution preprocessing with standard video codecs.
• pcc-eval-toolkitRate-distortion evaluation toolkit with gate-checked Bjontegaard BD-rate, matched-quality single-point comparison, and publication-style RD…
• bdcalculatorBD-rate calculator for comparing bitrate-quality performance of video codecs.
• Bjontegaard_metricPython implementation of the Bjontegaard metric computing BD-PSNR and BD-rate between two rate-distortion curves.
• Netflix per-shot encoding labReference recreation of Netflix per-shot encoding: convex-hull rate-distortion optimization on VMAF to build a quality-defined HLS ladder.
• Vulkan GuideKhronos-maintained developer guide for Vulkan, including the Vulkan Video API ecosystem and hardware-accelerated video decode/encode integr…
• MP4Box DASH packaging guide (gpac.io)Official gpac.io guide to MP4Box options for packaging DASH, HLS, and CMAF from a single MP4 workflow.
• Video Compression with Graph-inspired Neural Representation2024 arXiv paper benchmarking neural codec approach against VTM 20.0 (H.266/VVC reference), DCVC-FM, and traditional standards with compres…
• X265-pVMAF: A Real-Time Perceptual Video Quality Metric for HEVC Video Encoding2024 IEEE paper on real-time VMAF-based quality prediction for HEVC/H.265 encoding, addressing codec optimization and quality metric method…
• VDO.NinjaBrowser-based WebRTC tool for capturing and transporting remote video feeds into OBS and other production software, useful for low-latency…
• mosaicGo library for predictable, production-oriented adaptive-bitrate packaging that emits HLS and DASH from CMAF without a C++ packager toolcha…
• FFmpeg Formats DocumentationOfficial FFmpeg muxer and demuxer reference, including HLS and DASH output, MPEG-TS, and fragmented MP4 packaging options.