PyTorch Blog: TorchCodec — Easy and Efficient Video Decoding
Official launch post explaining TorchCodec's design, seeking/indexing model, GPU decode tradeoffs and benchmarks against prior PyTorch media APIs.
Link
Related resources
- TorchCodec Documentation — FFmpeg-Backed Video Decoding to TensorsMeta's library docs for decoding video/audio directly into PyTorch tensors with CPU and CUDA/NVDEC paths, index- and PTS-based frame access…
- TwelveLabs Marengo — Video Embedding Model DocumentationDocs for a multimodal video embedding model supporting long-form video with shot-boundary segmentation, used for search, dedup and content…
- PyNvVideoCodec API Programming GuideNVIDIA's Python bindings over the Video Codec SDK for GPU-accelerated decode/encode pipelines feeding ML and analytics workloads.
- Understanding HLS Interstitials and EXT-X-DISCONTINUITY in Ad InsertionEngineering comparison of HLS Interstitials against classic discontinuity-based SSAI splicing, with the practical tradeoffs of each approac…
- UVQ — Universal Video Quality (Google)Google's no-reference perceptual video quality model for user-generated content, scoring compression, content and distortion without a pris…
- hdr10plus_tool — Codec Wiki Usage GuideCommunity reference with flags and FFmpeg pipe recipes for extracting, injecting and inspecting HDR10+ dynamic metadata in HEVC/MKV.
- ColorVideoVDP — reference implementationPyTorch implementation of the ColorVideoVDP full-reference metric (SIGGRAPH 2024), usable as a CLI quality tool or as a differentiable perc…
- FFmpeg 8.0 whisper Filter DocumentationReference for FFmpeg 8.0's built-in Whisper ASR filter: model selection, VAD, queueing, and SRT/JSON transcript output destinations.
- OpenTimelineIO DocumentationDocs for the OTIO editorial timeline interchange API and adapters, including per-object metadata handling for post-production workflows.
- EBU ADM Guidelines and Example FilesEBU hub for Audio Definition Model guidelines, sample ADM/BW64 files and the ADM Production Profile for practical broadcast interchange.
- Shutter Encoder DocumentationDocs for the professional FFmpeg-based conversion GUI, covering its encode/decode functions, subtitle generation via Whisper, upscaling, an…