Install on your local PC/laptop: LINKS
Github (for Comfy UI) https://github.com/kijai/ComfyUILive...
My workflow with assets https://openart.ai/workflows/seal_har...
Made with Stable Diffusion and Comfy UI
#hedraai #ai #comfyui
More details about Live Portrait:
LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control is an innovative approach for creating lifelike video animations from a single source image. Here are the key details:
Objective: LivePortrait synthesizes realistic videos by using a single source image as an appearance reference and deriving motion (facial expressions and head pose) from a driving video, audio, text, or other sources.
Framework: Unlike mainstream diffusionbased methods, LivePortrait leverages an implicitkeypointbased framework. This approach balances computational efficiency and controllability.
Training Data: The model is trained on an extensive dataset of approximately 69 million highquality frames. A mixed imagevideo training strategy enhances generalization.
Enhancements:
Compact Implicit Keypoints: These keypoints effectively represent blendshapes, contributing to better generation quality.
Stitching and Retargeting Modules: These modules, implemented with a small MLP, enhance controllability without significant computational overhead.
Performance: LivePortrait achieves remarkable generation speed (12.8ms on an RTX 4090 GPU with PyTorch) even when compared to diffusionbased methods.