OpenSceneSense — AI video scene tagging
Description
Python library combining vision models and audio transcription with dynamic frame selection to auto-tag and describe video scenes.
Resource details
- Category path
- Media Tools›Metadata Extraction & Management
- Classification
- Not yet classified
OpenSceneSense — AI video scene tagging is cataloged in Media Tools and Metadata Extraction & Management.
URL
Related resources
- VideoTaggingToolAngular.js web app for managing users, videos, and tagging jobs with an extensible metadata schema for video annotation.
- ExifToolGold-standard metadata tool reading/writing 30,000+ tags across hundreds of formats including video containers.
- audioprintPython MFCC-based perceptual-hash audio fingerprinting library.
- python-video-converterPython library wrapping ffmpeg/ffprobe with a declarative Converter().convert() API for scripting format/audio/video conversion pipelines.
- Eyevinn auto-subtitlesWhisper-based automatic subtitle generation tool that chunks large audio and outputs VTT/SRT/JSON while preserving sync.
- CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.
- Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
- Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
- VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
- 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.