Scene Detection & Segmentation
Browse 30 curated scene detection & segmentation resources for video development on Awesome Video.
Resources
- AutoShotCVPR-NAS 2023 shot boundary detection model with a NAS-optimized architecture and the new SHOT dataset (853 videos, 11,606 annotations).
- AutoShot — A Short Video Dataset and State-of-the-Art Shot Boundary DetectionPaper introducing a short-video shot-boundary dataset and model that outperforms TransNetV2 on subtle transitions, with released code.
- ComskipTool for automatically detecting and marking commercial breaks in recorded video content.
- DSBD — Deep Shot Boundary Detection at ScaleSpatio-temporal CNN for shot boundary detection with an accompanying dataset emphasizing gradual transitions.
- Katnapip-installable MIT library for automated keyframe extraction (LUV color-diff), video compression, and smart image cropping.
- LMSKE — Keyframe Extraction for Video SummarizationLarge-model sequential keyframe extraction pipeline combining TransNetV2 shot segmentation, CLIP features, and adaptive clustering.
- MDLSeg: Parameter-Free Video Scene Segmentation via Minimum Description LengthAcademic paper proposing a parameter-free scene-segmentation method claimed to outperform PySceneDetect.
- MKV-Chapter-Maker — auto chapters via black/silence/sceneAutomatically generates MKV chapters using black-frame, silence or scene detection and writes them via mkvpropedit without re-encoding.
- MythTV: Commercial Detection with Silence ClusteringMythTV wiki documentation of silence-clustering commercial detection, including why naive silence detection fails on animation and children…
- PySceneDetect DocumentationCanonical docs for PySceneDetect's CLI and Python API: content/adaptive/threshold detectors and ffmpeg/mkvmerge-based video splitting.
- PySceneDetect Project Site and DocumentationOfficial docs for PySceneDetect covering detect-content and detect-adaptive algorithms, statsfile score export, and video splitting via ffm…
- PySceneDetect — Similar projects indexOfficial comparison page listing alternative scene/shot detection libraries and tools with notes on their approaches.
- Scene Detection Policies and Keyframe Extraction Strategies for Large-Scale Video Analysis2025 paper comparing scene-detection policies and keyframe extraction strategies at scale.
- Scene-boundary-detectionFrom-scratch implementation of "Ridiculously Fast Shot Boundary Detection with Fully Convolutional Neural Networks."
- SceneSeg (Local-to-Global Scene Segmentation)CVPR 2020 multimodal movie scene segmentation using place and audio features on the MovieNet dataset; reference ML baseline with code.
- SceneSegmentation-SCRLOfficial PyTorch implementation of CVPR 2022 Scene Consistency Representation Learning for movie-level scene segmentation (MovieNet/SceneSe…
- Scenecut ExtractorExtract scenecuts from video files using ffmpeg
- Shot Detection BenchmarksA comparison of FFmpeg, Shotdetect and PySceneDetect for shot transition detection
- ShotBoundaryDetectionSimple OpenCV-based scene boundary/shot transition detector, minimal dependencies, no deep learning framework needed.
- ShotDetectionC++/OpenCV LGPL shot boundary detection tool, outputs frame numbers/durations in XML/YAML/text.
- TransNetV2 — Deep Shot Boundary DetectorDeep 3D-CNN shot boundary/scene-cut detector, SOTA on ClipShots/BBC/RAI with real-time inference.
- Using FFmpeg's blackdetect Filter to Identify Commercial BlocksEmpirical evaluation of the ffmpeg blackdetect filter for locating ad breaks at TV-news scale, including concrete failure modes.
- VidChapters-7M (Vid2Seq)NeurIPS 2023 dataset-and-benchmark project plus Vid2Seq model for automatic video chapter generation at scale.
- av1-scdScene-change detection CLI generating encoder force-keyframe configs, wrapping selectable backends (pyscene, vs-xvid, av-scenechange, ffmpe…