AI & Machine Learning Tools
Explore 35 curated AI & Machine Learning Tools resources in Media Tools — tools, guides, and references for video developers on Awesome Video.
About this collection
AI & Machine Learning Tools is a focused collection within Media Tools, with 35 curated resources.
Resources
- AI-Youtube-Shorts-GeneratorLLM-driven highlight detection with Whisper transcription and automatic vertical cropping to turn long videos into shorts, MIT-licensed wit…
- Ad Insertion Sample (GitHub)The ad-insertion reference pipeline shows how to integrate various media building blocks, with analytics powered by the OpenVINO™ Toolkit,…
- An Overview of the JPEG AI Learning-Based Image Coding StandardIEEE overview paper describing JPEG AI's architecture and coding tools, the first standardized end-to-end learned codec.
- Audio TranscriberTranscodes audio & video files to text, supports MP3, M4A, WAV, MP4, MKV, AVI, MPG & MPEG. No Online API's. Python 3
- Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
- CompressAI-Vision — Video Coding for Machines evaluation platformFramework to design and benchmark video-coding-for-machines pipelines, comparing learned codecs against VTM/HM/JM anchors with MPEG FCM sup…
- DQ-Ladder: Deep Q-Network Time/Quality-Aware Bitrate LadderDeep reinforcement learning (DQN) approach to bitrate ladder construction achieving 10.3%+ BD-rate gain and 22% decode-time reduction.
- Deep Reinforced Bitrate Ladders (DeepLadder)NOSSDAV 2021 paper on deep-reinforcement-learning-based bitrate ladder construction for adaptive streaming.
- Efficient Bitrate Ladder Construction for Content-Optimized Adaptive StreamingAcademic paper (Katsenou et al.) using ML to predict Pareto-optimal bitrate ladders from spatio-temporal content features.
- FGVC[ECCV 2020] Flow-edge Guided Video Completion.
- FILM: Frame Interpolation for Large MotionGoogle Research's unified neural network for video frame interpolation handling large motion without requiring optical flow or depth estima…
- FlashVSRCVPR 2026 real-time diffusion-based streaming video super-resolution using one-step, locality-constrained sparse attention with a tiny cond…
- Fraunhofer NNCodec — MPEG Neural Network Coding Reference ImplementationOpen implementation of ISO/IEC 15938-17 (MPEG NNC) for compressing neural networks, conformant as of the 2.0 beta.
- InternVideo — Video Foundation Model FamilyProject page for the InternVideo video foundation models providing CLIP-style video/text embeddings for retrieval and understanding, spanni…
- JukeboxCode for the paper "Jukebox: A Generative Model for Music"
- MoMoAAAI 2025 "Disentangled Motion Modeling for Video Frame Interpolation," diffusion-based motion disentanglement approach.
- NVIDIA Maxine VFX SDK SamplesAI-powered real-time video effects (denoise, super-res, artifact removal) via Tensor Cores.
- ProPainterICCV 2023 video inpainting tool for object removal/completion using propagation and transformer-based approach, CLI-usable.
- PyNvVideoCodec API Programming GuideNVIDIA's Python bindings over the Video Codec SDK for GPU-accelerated decode/encode pipelines feeding ML and analytics workloads.
- PyTorch Blog: TorchCodec — Easy and Efficient Video DecodingOfficial launch post explaining TorchCodec's design, seeking/indexing model, GPU decode tradeoffs and benchmarks against prior PyTorch medi…
- RIFE (ECCV2022)Real-time flow-based video frame interpolation model, widely used as the backend for many interpolation tools.
- SimpleVQADeep-learning no-reference video quality assessment for user-generated content, in PyTorch with SlowFast feature extraction.
- Smart City SampleThe smart city reference pipeline shows how to integrate various media building blocks, with analytics powered by the OpenVINO™ Toolkit, fo…
- SparkVSRECCV 2026 interactive video super-resolution via sparse keyframe propagation, user super-resolves keyframes and it propagates the rest.