Open Source Media Framework

Intel's Open Source Media Framework provides tools and libraries to increase the speed and performance of video decoding, encoding, processing, and transcoding on compressed digital video and imaging. It supports workload offloading from the CPU to the GPU.

Link

• Visit resource

Related resources

• FOSDEM 2024: VVdeC<>Arm — Optimizing an Open Source VVC Decoder for Arm ArchitecturesFOSDEM Open Media devroom talk detailing Arm-specific performance optimization work on the open-source VVdeC VVC decoder.
• FOSDEM 2023: VVenC & VVdeC — Open Source Video Encoding and Playback for VVCFOSDEM Open Media devroom talk by Fraunhofer HHI developers presenting the VVenC encoder and VVdeC decoder for the VVC/H.266 codec.
• MLVC: Multi-platform Learned Video Codec for Real-World DeploymentAcademic paper on a neural video codec targeting competitive compression, real-time speed, and cross-platform (Apple/Intel/Qualcomm NPU) in…
• DeepGameReal-time content-adaptive encoding for cloud gaming using spatiotemporal DNN to weight regions by player gaze/interest, cutting bandwidth…
• OpenHardwareVC: Open-Source Library for 8K UHD Hardware (AVS3)ACM paper presenting an open-source hardware library targeting 8K UHD AVS3 chip design for video coding.
• Performance Comparison of AV1, JEM, VP9, and HEVC EncodersFraunhofer HHI SPIE 2017 paper comparing codec internals, BD-BR, and complexity across AV1, JEM, VP9, and HEVC.
• Differentiable VMAF Re-implementation on PyTorchDifferentiable PyTorch reimplementation of VMAF metric enabling gradient-based codec/RDO optimization, with companion code.
• nano-hevcMinimal educational HEVC encoder written in pure Python, readable-over-fast, for teaching codec internals.
• Opus (xiph/opus)Reference implementation of the Opus audio codec, recently adding deep-learning-based packet loss concealment.
• dav1d.wasmWASM port of the dav1d AV1 decoder, SIMD-optimized with TypeScript interfaces, aimed at production use in browsers.