Benchmarking & Performance Tools for Codecs

About this collection

Benchmarking & Performance Tools for Codecs is a focused collection within Encoding & Codecs, with 28 curated resources.

Resources (showing 1–24 of 28)

• aom_analyzerCLI AV1 bitstream analyzer for inspecting sequence, frame, tile, and superblock structure of AOM AV1 streams.
• Applying Objective Quality Metrics to Video-Codec ComparisonStudy of 789 encoded streams and 320k subjective scores analyzing VMAF correlation per colorspace for codec comparison.
• Are We Compressed YetDistributed encode/decode + BD-rate + VMAF benchmarking harness originally for Daala, adopted by AOM community for comparative testing of A…
• av1parserRust AV1 bitstream parser that dissects OBU/header structure for low-level stream inspection (not a full decoder).
• awcy — Are We Compressed Yet?Distributed encode/decode + BD-rate + VMAF codec comparison harness used by AOM for AV1 (libaom, SVT-AV1, rav1e), with comparative reports…
• bdcalculatorBD-rate calculator for comparing bitrate-quality performance of video codecs.
• Benchmarking Conventional and Learned Video Codecs with a Low-Delay ConfigurationAcademic benchmark comparing traditional (HEVC/VVC) and learned video codecs under low-delay configuration constraints.
• bjontegaard — BD-Rate Python Librarypip-installable BD-rate calculator with cubic-spline/PCHIP/Akima interpolation plus RCD plots; PCHIP matches Excel to 10 decimals.
• Bjontegaard_metricPython implementation of the Bjontegaard metric computing BD-PSNR and BD-rate between two rate-distortion curves.
• Comparing Video Encoders — Methodology GuidePractitioner guide to fair encoder comparison using SSIMULACRA2 and XPSNR: CRF sweeps, score aggregation, and common benchmarking pitfalls.
• Differentiable VMAF Re-implementation on PyTorchDifferentiable PyTorch reimplementation of VMAF metric enabling gradient-based codec/RDO optimization, with companion code.
• encAlotPython automation for research encodes with HEVC HM, VVC VTM, and VVenC that extracts encoder stats and libVMAF scores.
• encoder-benchmark — Realtime HW Encode BenchmarkRust tool benchmarking real-time hardware encode fps, with permutor-cli automating bitrate/resolution/fps/quality permutation testing.
• Making the rav1d Video Decoder 1% FasterDetailed performance teardown of the Rust rav1d AV1 decoder versus C dav1d, walking through profiling and codegen-level fixes.
• MSU Video Codecs Comparison 2025MSU Graphics & Media Lab’s 2025 independent codec comparison covering AV1, VVC, HEVC and other encoders with objective and subjective resul…
• Netflix per-shot encoding labReference recreation of Netflix per-shot encoding: convex-hull rate-distortion optimization on VMAF to build a quality-defined HLS ladder.
• Optimizing rav1d, the Rust AV1 decoder (Prossimo)Engineering writeup from ISRG's Prossimo on closing the performance gap between rav1d and dav1d, detailing the specific Rust codegen and me…
• pcc-eval-toolkitRate-distortion evaluation toolkit with gate-checked Bjontegaard BD-rate, matched-quality single-point comparison, and publication-style RD…
• rd_tool — AWCY Encode BackendEncode/decode/metrics job-distribution backend for Are We Compressed Yet, distributing codec RD tests over worker cores.
• RDPlot — Rate-Distortion Plotting ToolQt GUI that parses encoder logs from reference software (HM/VTM/etc) and plots rate-distortion curves.
• SR+Codec: a Benchmark of Super-Resolution for Video Compression Bitrate Reduction2023 peer-reviewed benchmark paper analyzing bitrate savings (up to 65%) through super-resolution preprocessing with standard video codecs.
• SVT-AV1 Deep Dive — preset/CRF benchmark methodologyLarge-scale SVT-AV1 benchmark (thousands of encodes) across presets and CRF using SSIMULACRA2 and XPSNR with documented harmonic-mean metho…
• The Practice of Averaging Rate-Distortion Curves over Testsets to Compare Learned Video Codecs Can Cause Misleading Conclusions2024 peer-reviewed paper analyzing codec benchmarking methodology, specifically BD-rate averaging and evaluation best practices for compari…
• Transcoding Performance TrialRuns FFmpeg transcoding processes simultaneously and measures CPU performance