I am trying to create a system where a user uploads an image of an animal and types a message, and the system generates a video with AI-generated speech, synchronized lip movements, and eye blinking for the animal. I have explored platforms like Vidnoze, D-ID Studio, Lipsync AI by Gooey, and Python packages like Wave2Lip and LipGAN. However, these solutions work well for human faces but don't seem to work on animal images.
I am particularly struggling with lip sync and realistic eye blinking for animal faces. Are there any existing tools, models, or techniques to achieve this for animals? Any suggestions or guidance on how to train or modify models for animal faces would be greatly appreciated.
Top comments (0)