Temporal — media processing workflows

Description

Writeup mapping download/encode/merge/upload media pipelines onto durable Temporal workflows and activities, with retry and failure semantics.

URL

• Visit resource

Related resources

• auto-transcode-watcherPython+watchdog+FFmpeg folder watcher with file stabilization, retry queue, rename templates, and YAML config.
• VoltageFFmpeg-based encoding API supporting concurrent instances with a priority/retry job queue and webhook notifications.
• distributed-transcoderDistributed video transcoding system using RabbitMQ job distribution, GStreamer transcoding, and MinIO storage with FastAPI/React interface.
• AV1 Encoding with libsvtav1 on QencodeThe libsvtav1 encoder (SVT-AV1) is an AV1 implementation tuned for both compression efficiency and parallel performance. This guide covers…
• Are We Compressed YetDistributed encode/decode + BD-rate + VMAF benchmarking harness originally for Daala, adopted by AOM community for comparative testing of A…
• FOSDEM 2024: VVdeC<>Arm — Optimizing an Open Source VVC Decoder for Arm ArchitecturesFOSDEM Open Media devroom talk detailing Arm-specific performance optimization work on the open-source VVdeC VVC decoder.
• Differentiable VMAF Re-implementation on PyTorchDifferentiable PyTorch reimplementation of VMAF metric enabling gradient-based codec/RDO optimization, with companion code.
• Performance Comparison of AV1, JEM, VP9, and HEVC EncodersFraunhofer HHI SPIE 2017 paper comparing codec internals, BD-BR, and complexity across AV1, JEM, VP9, and HEVC.
• nano-hevcMinimal educational HEVC encoder written in pure Python, readable-over-fast, for teaching codec internals.
• Opus (xiph/opus)Reference implementation of the Opus audio codec, recently adding deep-learning-based packet loss concealment.