Aeneas

Description

Aeneas is a Python library and command-line tool for automating the synchronization of audio and text (forced alignment). It can be used to align subtitles with audio tracks, making it useful for developers working on video streaming and encoding projects that require precise subtitle timing.

URL

• Visit resource

Related resources

• SubalignerAutomatic subtitle synchronization tool using deep neural networks and forced alignment, with translation support.
• Eyevinn auto-subtitlesWhisper-based automatic subtitle generation tool that chunks large audio and outputs VTT/SRT/JSON while preserving sync.
• spectreGo audio fingerprinting library built specifically for syncing movie subtitles to audio tracks.
• audioprintPython MFCC-based perceptual-hash audio fingerprinting library.
• alass — Automatic Language-Agnostic Subtitle SynchronizationRust CLI tool for automatic subtitle sync handling offset drift, ad-break splits, and framerate differences, 88-98% good-sync rate.
• Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
• Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
• VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
• CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.
• 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.