SparseSync: Audio-Visual Synchronisation with Trainable Selectors
BMVC 2022 Spotlight paper and code for sparse-in-space-and-time audio-visual sync detection.
Link
Related resources
- SpectroMap: Peak Detection Algorithm for Audio FingerprintingAcademic paper on a peak-detection algorithm for audio fingerprinting with implementation.
- audioprintPython MFCC-based perceptual-hash audio fingerprinting library.
- spectreGo audio fingerprinting library built specifically for syncing movie subtitles to audio tracks.
- PanakoContent-based audio search and fingerprinting system robust to noise and distortion, with stream-monitoring subapps, academic-backed.
- Olaf (Overly Lightweight Acoustic Fingerprinting)Portable C library for acoustic fingerprinting, runs on embedded devices and WASM.
- 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.
- Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
- Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
- VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
- CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.