VidChapters-7M (Vid2Seq)

Description

NeurIPS 2023 dataset-and-benchmark project plus Vid2Seq model for automatic video chapter generation at scale.

URL

• Visit resource

Related resources

• MDLSeg: Parameter-Free Video Scene Segmentation via Minimum Description LengthAcademic paper proposing a parameter-free scene-segmentation method claimed to outperform PySceneDetect.
• SceneSegmentation-SCRLOfficial PyTorch implementation of CVPR 2022 Scene Consistency Representation Learning for movie-level scene segmentation (MovieNet/SceneSe…
• GHVQ: Benchmark and Metric for AI-Generated Human-Activity Video QualityAcademic paper introducing a benchmark dataset and objective quality metric for AI-generated human-activity video, with companion code.
• Eyevinn auto-subtitlesWhisper-based automatic subtitle generation tool that chunks large audio and outputs VTT/SRT/JSON while preserving sync.
• VQA² (Visual Question Answering for Video Quality Assessment)ACM MM 2025 paper and code for VQA²-Assistant, a unified video/image quality scoring and interpretation model.
• 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.
• Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
• Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
• VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
• CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.