DeepGame
Real-time content-adaptive encoding for cloud gaming using spatiotemporal DNN to weight regions by player gaze/interest, cutting bandwidth ~36% without encoder or game source changes.
Link
Related resources
- VidaptiveDecouples video encoding from transport, pacing frames at congestion-control rate and dynamically retargeting encoder bitrate to CCA capaci…
- FPGA-based Logarithmic Hop Encoding for Low-Latency Real-Time Video (Drones)Peer-reviewed paper on an FPGA-implemented low-latency real-time video encoder (LHE) for embedded/drone applications, with companion code r…
- Content-Driven Frame-Level Bit Prediction for Rate Control in Versatile Video CodingAcademic paper on frame-level rate control for VVC, building on VVenC rate-capping for real-time-oriented bit allocation.
- Evaluation of GPU Video Encoders for Low-Latency Real-Time 4K UHD EncodingAcademic benchmark of HEVC/AV1 GPU encoders targeting sub-2-second and sub-500ms latency tiers for real-time 4K UHD encoding.
- Sustainable Real-Time 8K60 HEVC Encoding for V2XPaper on repurposing legacy Pascal-generation NVENC hardware for real-time 8K60 HEVC encoding via split-frame encoding, targeting V2X appli…
- nano-hevcMinimal educational HEVC encoder written in pure Python, readable-over-fast, for teaching codec internals.
- FOSDEM 2024: VVdeC<>Arm — Optimizing an Open Source VVC Decoder for Arm ArchitecturesFOSDEM Open Media devroom talk detailing Arm-specific performance optimization work on the open-source VVdeC VVC decoder.
- jxs (JPEG XS reference)Reference software implementation of ISO/IEC 21122-5 (JPEG XS) including jxs_encoder binary, supports PNM/PGX/raw YUV/RGB input.
- Differentiable VMAF Re-implementation on PyTorchDifferentiable PyTorch reimplementation of VMAF metric enabling gradient-based codec/RDO optimization, with companion code.
- Performance Comparison of AV1, JEM, VP9, and HEVC EncodersFraunhofer HHI SPIE 2017 paper comparing codec internals, BD-BR, and complexity across AV1, JEM, VP9, and HEVC.