A Blender addon for automatic lip-syncing based on audio input.
Cross-platform (Windows, macOS, Linux), works out of the box with ~25 languages.

⚡ Just install it from Blender’s Add-ons panel and you’re ready to go!

Video Demo

https://github.com/user-attachments/assets/cb90ea7b-02fc-4ca1-b19f-631024cd79cd

https://github.com/user-attachments/assets/57ea3912-2d50-4090-ba49-3035ab673a05

Animated Platformer Character by Quaternius

Wall Art 06 by Jarlan Perez CC-BY via Poly Pizza

✨ Features

🎤 Converts voice audio into animated mouth shapes
Interpolates between Shape Key to give natural lips motion
🖼️ Projects a viseme spritesheet onto your character’s face (one spritesheet is shipped with the add-on, but you can use your own)
🧠 Uses offline speech recognition (Vosk + Phonemizer + eSpeak)
🖥️ Fully supported on Windows, macOS and Linux
🔜 Future upgrade: Pose-based animation for facial rigs

📦 Installation

Open Blender.
Go to Edit > Preferences > Get Extensions.
Look for Lip Sync
Install it – done!

When you select a Language Model for the first time, Model file is downloaded and cached for future uses (~40Mo, depending on the language).

🛠️ How to Use (Spritesheet)

Import or create a 3D character.
Add your movie / sound clip in Video Sequencer
Go to the Lip Sync tab in the N-panel.
Select your Language among 30 available languages.
Click Add Spritesheet on Selection
Click Set Mouth Area from Edit Mode
Click Analyze Audio and wait few seconds – your character now speaks!

🚧 Roadmap

Sprite-based viseme projection
Timeline keyframe baking
Shapekey-based viseme support
Pose-based animation

🐞 Known Issues

Characters require no rotation and applied Scale

🧩 Compatibility

Blender 4.4+
Works on Windows, macOS, and Linux

🤝 Contribute

Found a bug or want to help improve the addon?
Open an issue or submit a pull request – contributions are welcome!

📜 License

This project is licensed under the GNU General Public License v3.0 or later.

Made with ❤️ by Charley 3D

README.md Unescape Escape

🗣️ Blender Lip Sync Addon