This is a simplified guide to an AI model called Live-Portrait maintained by Fofr. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter.
Model overview
The live-portrait model is an efficient portrait animation system that uses a driving video source to animate a portrait. It is developed by the Replicate creator fofr, who has created similar models like video-morpher, frames-to-video, and toolkit. The live-portrait model is based on the research paper "LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control" and shares some similarities with other portrait animation models like aniportrait-vid2vid and livespeechportraits.
Model inputs and outputs
The live-portrait model takes a face image and a driving video as inputs, and generates an animated portrait that follows the movements and expressions of the driving video. The model also allows for various configuration parameters to control the output, such as the size, scaling, positioning, and retargeting of the animated portrait.
Inputs
- Face Image: An image containing the face to be animated
- Driving Video: A video that will drive the animation of the portrait
- Live Portrait Dsize: The size of the output image
- Live Portrait Scale: The scaling factor for the face
- Video Frame Load Cap: The maximum number of frames to load from the driving video
- Live Portrait Lip Zero: Whether to enable lip zero
- Live Portrait Relative: Whether to use relative positioning
- Live Portrait Vx Ratio: The horizontal shift ratio
- Live Portrait Vy Ratio: The vertical shift ratio
- Live Portrait Stitching: Whether to enable stitching
- Video Select Every N Frames: The frequency of frames to select from the driving video
- Live Portrait Eye Retargeting: Whether to enable eye retargeting
- Live Portrait Lip Retargeting: Whether to enable lip retargeting
- Live Portrait Lip Retargeting Multiplier: The multiplier for lip retargeting
- Live Portrait Eyes Retargeting Multiplier: The multiplier for eye retargeting
Outputs
- An array of URIs representing the animated portrait frames
Capabilities
The live-portrait model can efficien...
Top comments (0)