Text2Video-Zero

Description

An AI model (ICCV 2023) for zero-shot text-to-video generation using image diffusion models. It allows generating short video clips from text prompts without training on video data.

URL

• Visit resource

Related resources

• VQA² (Visual Question Answering for Video Quality Assessment)ACM MM 2025 paper and code for VQA²-Assistant, a unified video/image quality scoring and interpretation model.
• KVQ: NTIRE 2024 Short-form UGC Video Quality Assessment ChallengeCVPR NTIRE 2024 challenge dataset and code for short-form UGC video quality assessment, 600 videos/3600 processed clips.
• KSQI: Knowledge-driven Streaming Quality IndexKnowledge-driven QoE model for adaptive streaming video with implementations of multiple objective QoE models, companion to arXiv:1911.0794…
• A Gamut-Mapping Framework for Color-Accurate Reproduction of HDR ImagesAcademic paper (Sikudova et al.) proposing a gamut-mapping framework for color-accurate HDR image reproduction.
• whisper-subtitlesAccessibility-focused local subtitle generation using Whisper+OpenVINO, targeting hearing-impaired users across 99 languages.
• CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.
• 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.
• Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
• Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
• VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.