First Order Motion Model

A famous deep learning model for image animation (e.g., making a single portrait image speak or move) by modeling motion as a first order approximation. Often used in one-shot talking head video generation.

Link

Related resources

  • Text2Video-ZeroAn AI model (ICCV 2023) for zero-shot text-to-video generation using image diffusion models. It allows generating short video clips from te…
  • OpenPoseA real-time multi-person keypoint detection library (for body, face, and hands) by CMU. Often used on video to extract pose information fra…
  • OpenColorIOAn open source color management solution geared towards motion picture production. Developed by the Academy Software Foundation, OpenColorI…
  • VideoReTalkingA research project (SIGGRAPH Asia 2022) providing code for audio-driven lip synchronization in talking head videos. It enables realistic re…
  • BackgroundRemoverAn AI-powered command-line tool to remove the background from images and videos. It uses deep learning to perform background removal with a…
  • InfraRecorderAn open source DVD burning tool that, among other features, can be used to author basic video DVDs (it includes support for creating video…
  • ScreenToGifAn open source tool to record a selected screen area, webcam, or whiteboard and export it as an animated GIF or video. It includes basic ed…
  • Blender (Video Sequence Editor)The video sequence editor within Blender, an open source 3D creation suite. It provides basic cutting, transitions, color grading, and mask…
  • FreeCutProfessional-grade browser-based video editor with multi-track editing, WebGPU/WebCodecs support, keyframe animations, AI tools, real-time…