Skip to content
Agents tracked: 492 Releases (7d): 545 Agent status: 1 with issuesSince last limit reset: Claude 9d · Codex 7d For AI agents: Markdown Updated Nov 20, 2026

VOCA (Voice Operated Character Animation)

by Max Planck Institute for Intelligent Systems

Speech-driven 3D facial animation model with code; data and trained model need a free sign-in.

AI presenters and avatars Open source

GitHub repo

2. Commercial use: voca.is.tue.mpg.de/license.html

“Any other use, in particular any use for commercial purposes, is prohibited.”

Any commercial use, including a commercial product or service, is forbidden without a separate license.

voca.is.tue.mpg.de/license.html

License checked Oct 27, 2026 against 1 official page. Tap a verdict to see its source. How we checked Report an error

VOCA: a 3D face that talks along with a voice

VOCA is a research model from the Max Planck Institute that moves a 3D head model's lips, jaw and face to match any speech recording. You give it a sound file and a still 3D face, and it returns an animation you can render to video. It is free only for non-commercial research, teaching and art, and the model files need a free sign-up.

Where you can use it

A talking 3D head from a voice clip

Record or pick a speech clip and let VOCA move a 3D face to it. You get a short video and the face shapes for every frame.

Lip-sync for game and VR characters

Animate a character's face for a game scene or a virtual reality avatar when you do not know the speaker or language in advance. This fits non-commercial and art projects only.

Add blinks and head turns

After the speech animation is done, add eye blinks, change the face shape or turn the head, so the result looks less stiff.

New faces to animate

Make random new heads to try the same speech on different faces, or build a head from a photo with the related RingNet project.

A class project on talking faces Idea

Students can compare how speaking styles change the same sentence, using the ready style switch, in a course or thesis.

Animated preview for a short art film Idea

Give a sculpted or scanned head a voice for a non-commercial short film or gallery piece, then render it in your own tool.

As reported by Max Planck Institute for Intelligent Systems: VOCASET has about 29 minutes of 4D scans at 60 fps with audio from 12 speakers.

VOCA (Voice Operated Character Animation) popularity

10 / 100
Gid Score, same scale as developer tools
1,271
GitHub stars
VOCA (Voice Operated Character Animation): GitHub starsTimoBolkart/voca 1,271

How the Gid Score is calculated

How to start

Tell your AI assistant

“Set up VOCA from github.com/TimoBolkart/voca in a Python 3.6 or 3.7 virtual environment with the pinned TensorFlow 1.x requirements, wait for me to download the model and FLAME files after I sign up, then run run_voca.py on my wav file with --visualize False and keep it to my non-commercial project.”

Show codeStep 1 or Step 2 or Step 3

Make a Python virtual environment (the code was tested on Python 3.6.8 and TensorFlow 1.14), install FFmpeg and the MPI-IS mesh library, then the requirements.

git clone https://github.com/TimoBolkart/voca.git
pip install -r requirements.txt

Mistakes to avoid

Install it on a current Python with the latest TensorFlow 2
Use an old Python (3.6 or 3.7) virtual environment and the pinned TensorFlow 1.x from requirements.txt

The code was written and tested for TensorFlow 1.

pip install psbody-mesh from PyPI, or skip it
Build the mesh library from github.com/MPI-IS/mesh inside the same virtual environment

Without it the run stops with ModuleNotFoundError No module named 'psbody'.

Run the demo on a remote server with the default video rendering
Add --visualize False and render the saved face shapes later with another tool

The default renderer breaks on some setups, such as remote machines.

The agent types the person's VOCA and FLAME username and password into fetch_data.sh
The person runs fetch_data.sh, or downloads the files from the two sites by hand

The script asks for the person's own account login for each site.

Pass any 3D head file, such as a game character, as --template_fname
Use a head in FLAME topology (fitted to a scan or image, or sampled with sample_templates.py)

VOCA can only animate heads that share FLAME's structure.

License

Max Planck non-commercial research license. Free only for non-commercial research, teaching and art projects. Paid products, paid services, sharing the files with others and pornographic use are not allowed; commercial use needs a separate deal with Max Planck.

Commercial use
No

“Any other use, in particular any use for commercial purposes, is prohibited.” voca.is.tue.mpg.de/license.html

Credit
Not stated
Inside your app or game
Not allowed

“incorporation in a commercial product, use in a commercial service, or production of other artefacts for commercial purposes.” voca.is.tue.mpg.de/license.html

Pass the files on to your users
Not allowed

Sharing, reselling or sublicensing is forbidden; one archive copy is allowed.

“The Data and Software and the license herein granted shall not be copied, shared, distributed, re-sold, offered for re-sale, transferred or sub-licensed in whole or in part except that you may make one copy for archive purposes only.” voca.is.tue.mpg.de/license.html

Monetized YouTube
Not stated

“Any other use, in particular any use for commercial purposes, is prohibited.” voca.is.tue.mpg.de/license.html

AI training
Banned by the terms

“This license also prohibits the use of the Data and Software to train methods/algorithms/neural networks/etc. for commercial use of any kind.” voca.is.tue.mpg.de/license.html

Bots and bulk downloads
Not stated

AllowedWith conditionsNot allowedNot stated or not checked yet

Is VOCA (Voice Operated Character Animation) free for commercial use? The full answer Not legal advice. Check the license page before you ship.

For your agent

License rules tell your agent what it may do with VOCA (Voice Operated Character Animation). Paste them into your prompt or AGENTS.md.

License rules
- VOCA (Voice Operated Character Animation) (AI presenters and avatars). Speech-driven 3D facial animation model with code; data and trained model need a free sign-in. Price: free; non-commercial only; cannot ship inside an app; no AI training on its content.
  Connect: download from https://github.com/TimoBolkart/voca (no API).
  Rule: Non-commercial research, education and artistic projects only.
  Rule: No redistribution of the data or software; no use in commercial services.
  Rule: Do not use it for pornographic material.
  License: https://voca.is.tue.mpg.de/license.html (checked 2026-10-27; details: https://agentgid.com/assets/voca/)
Can an agent use it by itself?
No.
API, key or account
Not needed. Everything runs on your side.
MCP server
None found
Credit line, if you want one
Animation made with VOCA (Max Planck Institute for Intelligent Systems), voca.is.tue.mpg.de, for non-commercial research
This card for machines

Alternatives

VOCA (Voice Operated Character Animation) This page

Free Non-commercial Download

LivePortrait

Pick LivePortrait when you want to animate a portrait photo from a driving video, not a 3D head from sound.

Free With conditions Download

SoulX-FlashTalk

Pick SoulX-FlashTalk when you need a talking-avatar video made from an image and a voice, not 3D face shapes.

Free Commercial OK Download

HeyGen

Pick HeyGen when the talking presenter video is for a business and you are fine paying a hosted service.

Free tier With conditions MCP, API, npm

Synthesia

AI avatar video platform with an API and MCP; free videos carry a watermark.

Free tier With conditions MCP, API

Vidyard

Video hosting and messaging platform with AI avatar presenters, personalized video generation and analytics for sales teams.

Free tier With conditions MCP

All ai presenters and avatars

Questions

Can I use VOCA for a paid app, a client job or a monetised video?

No. The license allows only non-commercial research, teaching and art; commercial use needs a separate license from Max Planck.

Does it work with speech that is not in English?

Yes, the project page says it takes any speech, including other languages.

Can I animate my own 3D character with it?

Only a head in FLAME topology. You can make one by fitting FLAME to a scan or an image, or by sampling random FLAME heads.

Can I change how the person speaks or moves the head?

Yes. VOCA has controls for speaking style, face shape and head, jaw and eye rotation.

Can I share the model files with my team or put them in my project download?

No. Each person gets the license personally, and the files may not be shared, except one archive copy.