Aeneas

Aeneas is a Python library and command-line tool for automating the synchronization of audio and text (forced alignment). It can be used to align subtitles with audio tracks, making it useful for developers working on video streaming and encoding projects that require precise sub

Link

Related resources

  • WhisperXASR pipeline producing word-level timestamps via wav2vec2 forced alignment plus speaker diarization, useful for accurate subtitle cue timin…
  • stable-tsWhisper-based transcription with forced alignment and audio indexing, including a mode that loads audio in 30s chunks for near-streaming su…
  • IMFTool — IMF CPL editor with IMSC subtitlesOpen-source editor for IMF (Interoperable Master Format) Composition Playlists with IMSC1 text-profile subtitle decode/render/preview.
  • subsaiSubtitle generation tool with WebUI, CLI, and Python API using faster-whisper; exports srt/ass/ssa/sub/json/txt/vtt with translation suppor…
  • Whisper-WebUI — subtitle generation UIGradio UI generating subtitles from files/YouTube/mic using faster-whisper; outputs SRT/WebVTT, translation (NLLB/DeepL), Silero VAD, diari…
  • AutoSubSyncSubtitle auto-sync GUI wrapping ffsubsync/autosubsync/alass; can sync against a reference subtitle instead of the video.
  • SceneSeg (Local-to-Global Scene Segmentation)CVPR 2020 multimodal movie scene segmentation using place and audio features on the MovieNet dataset; reference ML baseline with code.
  • butteraugli (Rust port)Pure Rust port of Butteraugli from libjxl with XYB color, visual masking, and multi-scale bands, validated to within 0.001% of the referenc…
  • SimpleVQADeep-learning no-reference video quality assessment for user-generated content, in PyTorch with SlowFast feature extraction.
  • AutoShotCVPR-NAS 2023 shot boundary detection model with a NAS-optimized architecture and the new SHOT dataset (853 videos, 11,606 annotations).