Quality & Testing

Browse 11 curated quality & testing resources for video development on Awesome Video.

Resources (showing 1–33 of 33)

  • psy-ex/metricsPerceptual video metrics toolkit computing SSIMULACRA2, Butteraugli, CVVDP, weighted XPSNR, VMAF NEG, SSIM, and PSNR via helper scripts.
  • ssimu2xpsnr_plotterBash tool that encodes x264/x265/SVT-AV1/VVenC across CRF values, measures XPSNR and SSIMULACRA2, and plots rate-distortion curves.
  • bdr-ssimu2Python/matplotlib tool computing SSIMULACRA2 BD-rate curves with average and harmonic-mean plots and temporal subsampling.
  • butteraugli (Rust port)Pure Rust port of Butteraugli from libjxl with XYB color, visual masking, and multi-scale bands, validated to within 0.001% of the referenc…
  • ITU-T P.1203 reference implementationOfficial Python reference implementation of the ITU-T P.1203 HTTP adaptive streaming QoE model (modes 0-3), outputting per-second and integ…
  • Content Delivery Video Library (CDVL)An online library of test video content and sequences provided for researchers and developers to evaluate video processing and streaming te…
  • Sintel (Open Movie)A 15-minute open source animated film (2010) by Blender Institute. It's frequently used for benchmarking video encoders and playback device…
  • Big Buck Bunny (4K UHD Demo)A short animated film by the Blender Foundation (2008). It's open content and commonly used as demo video footage for testing 4K, HDR, and…
  • Stb-testerAn automation tool for testing set-top boxes and video devices. stb-tester uses a Raspberry Pi with a capture card to run automated tests (…
  • Conviva Streaming Performance Index (Report)Conviva regularly publishes 'State of Streaming' reports which provide analytics on streaming quality (startup times, rebuffer rates, bitra…
  • Streaming Video Experimentation at NetflixNetflix Tech Blog article explaining how Netflix conducts A/B testing and experimentation on streaming video quality and features to optimi…
  • Toward a Better Quality Metric for the Video CommunityNetflix Tech Blog article discussing the need for improved video quality metrics beyond existing ones like PSNR or SSIM, and how metrics li…
  • CAMBI: A Banding Artifact DetectorNetflix Tech Blog article introducing CAMBI (Contrast-Aware Multi-scale Banding Index), a metric Netflix developed to automatically detect…
  • Unified Streaming ValidatorUnified Streaming's Validator checks the compliance and quality of streaming content, supporting various streaming protocols.
  • Dolby Stream ValidatorDolby's Stream Validator assesses streaming content for Dolby audio and video standards, ensuring high-quality media delivery.
  • VQMTVQMT: Video Quality Measurement Tool. Fast implementations of the following objective image quality metrics: PSNR, SSIM, MS-SSIM, VIFp, PSN…
  • VQEG Tools and Subjective Labs SetupProviding the video quality research community with a wide variety of software tools and guidance in order to facilitate research.
  • AVRateAn open source modular Audio/Visual subjective evaluation test interface - Telecommunication-Telemedia-Assessment/AVRate.
  • Vaapi FitsIntel/vaapi-fits - A GitHub repository for video/multimedia development.
  • StreamsimVQEG/streamsim - A GitHub repository for video/multimedia development.
  • Test Engine Live ToolsSmall tools and scripts for the EBU test engine platform. - ebu/test-engine-live-tools.
  • Test Engine OndemandEBU on-demand test engine.
  • WisualWeb for Visual Quality Assessment.
  • FlusterTesting framework for decoders conformance.
  • Video Quality AssessmentIn Eyevinn’s initiative to share our knowledge around quality we continue with addressing video quality assessment; from both a subjective…
  • Toward A Practical Perceptual Video Quality Metricmeasuring video quality accurately at scale
  • VMAF: The Journey Continuesby Zhi Li, Christos Bampis, Julie Novak, Anne Aaron, Kyle Swanson, Anush Moorthy and Jan De Cock
  • R4WG20 QoE MetricsIssue tracking repository for the R4-Wg20 QoE Initiative - cta-wave/R4WG20-QoE-Metrics
  • VideobenchVMAF PSNR Bitrate Analyzer.
  • Video Bench — How measure your video quality easilyVideo Bench — How measure your video quality easily — video development resource from medium.com.
  • VmafPerceptual video quality assessment based on multi-method fusion. - Netflix/vmaf
  • HLS Stream Health Monitoring ToolHLS stream health monitoring utility tool provides an report of live HLS stream. This utility tool checks the all available bitrate streams…
  • QctoolsA tool or resource for quality-analysis-metrics.