ffsubsync
A tool to automatically synchronize subtitles with video by analyzing audio tracks. It uses speech detection to align subtitle timing via FFmpeg and machine learning.
Link
Related resources
- Normalize-AudioBatch EBU R128 loudness normalization tool for MKV files via ffmpeg, preserves video stream and caches loudness analysis.
- SubalignerAutomatic subtitle synchronization tool using deep neural networks and forced alignment, with translation support.
- Eyevinn auto-subtitlesWhisper-based automatic subtitle generation tool that chunks large audio and outputs VTT/SRT/JSON while preserving sync.
- spectreGo audio fingerprinting library built specifically for syncing movie subtitles to audio tracks.
- SpectroMap: Peak Detection Algorithm for Audio FingerprintingAcademic paper on a peak-detection algorithm for audio fingerprinting with implementation.
- Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
- aws-batch-with-FFmpegReference architecture running FFmpeg containers (ARM64/x86-64/NVIDIA/Xilinx) on AWS Batch with Spot compute environments and SDK/REST job…
- Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
- VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
- CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.