Avatarify
A real-time photorealistic avatar substitution tool. Avatarify uses neural networks to map your facial movements onto a target portrait (e.g., on Zoom or Skype) for fun impersonation or puppeteering.
Link
Related resources
- RobustVideoMattingReal-time human video matting via recurrent neural network requiring no green screen, achieving 4K 76FPS on GTX 1080 Ti, companion to arXiv…
- SubalignerAutomatic subtitle synchronization tool using deep neural networks and forced alignment, with translation support.
- BackgroundMattingV2Real-time high-resolution background matting requiring a captured background plate, achieving 4K 30fps on RTX 2080 Ti, companion to arXiv:2…
- Evaluating Video Quality Metrics for Neural and Traditional Codecs (4K/UHD-1)Academic comparison of VMAF, AVQBits, and FasterVQA no-reference quality metrics on 4K content.
- gamutthingyColor gamut conversion tool implementing chromatic adaptation and gamut compression mapping (HLPCM) with quasirandom dithering.
- Bitrate Ladder Construction via Transfer Learning and Spatio-Temporal FeaturesML-based bitrate ladder optimization achieving 94.1% complexity reduction at only 1.71% BD-rate cost using transfer learning.
- VMAF-torchPyTorch reimplementation of VMAF metric, GPU/gradient-friendly for use in learned codec optimization loops.
- CompressedVQA: Full/No-Reference VQA for Compressed UGC VideoICME 2021 grand challenge-winning full-reference and no-reference video quality models for compressed user-generated content.
- 2BiVQA: Double Bi-LSTM No-Reference Video Quality AssessmentNo-reference VQA model for UGC video using double Bi-LSTM, companion code to arXiv:2208.14774.
- nr-vqa-consumervideoNo-reference video quality metric tuned for consumer video capture artifacts (sensor noise, motion blur, shake) rather than compression art…