AI dubbing: your video in another language, with the mouth to match
By VODOO AI · · 4 min read
Dubbing used to mean a studio, a voice actor per language and weeks of work. With AI, the same ad, interview or explainer can be in French, Spanish and Portuguese the same afternoon, in a voice close to the original, with the mouth moving to the new words.
This guide explains the four steps every dub goes through, which ones you can skip, and what to check before a dub goes out under your name.
The four steps of a dub
Transcript
- What happens
- Every word and when it is said
- Why it matters
- You can't translate to length without knowing the length
Translation
- What happens
- Written to fit the time, not word for word
- Why it matters
- A literal line runs long and falls out of sync
New voice
- What happens
- The lines read in the new language
- Why it matters
- Matched to the original's pace and tone
Lip sync
- What happens
- The mouth moved to the new words
- Why it matters
- Without it, it's a voiceover, not a dub
| Step | What happens | Why it matters |
|---|---|---|
| Transcript | Every word and when it is said | You can't translate to length without knowing the length |
| Translation | Written to fit the time, not word for word | A literal line runs long and falls out of sync |
| New voice | The lines read in the new language | Matched to the original's pace and tone |
| Lip sync | The mouth moved to the new words | Without it, it's a voiceover, not a dub |
Lip sync is the one step you can skip. If the speaker is mostly off screen, or the shots are wide, a voiceover in the new language is cheaper and nobody will notice. When a face fills the frame, matching the mouth is what makes it believable.
What dubs well
- One speaker facing the camera: interviews, founder videos, explainers.
- Clear speech without music underneath it.
- Lines of normal length, with pauses between them.
- Harder: several people talking over each other, shouting, singing, or a face turned away.
Briefs to copy
Dub this ad into French, Spanish and Portuguese. Keep the speaker's voice warm and quick like the original, fit every line to its original length, and match the mouth.Make this in VODOO →
Dub this founder interview into English. Keep her calm, measured delivery, keep product names in their original form, and match the mouth when she is on screen.Make this in VODOO →
Translate this training video into German as a voiceover. Keep the pace, keep the technical terms exact, and leave the original sound low underneath.Make this in VODOO →
Which languages to start with
Start where your viewers already are. Your analytics show which countries watch your videos or visit your store; dub into the top one or two languages there before anything else. For most English-language brands that means Spanish, Portuguese for Brazil, French and German.
- Dub the videos that already work in your own language first: your best ad, your best explainer.
- Keep one version per language, and name the files clearly so they're easy to swap.
- Translate the on-screen text and captions too, not only the speech.
- Check local rules for ads, such as what counts as a health claim, before you run them.
Check it before it goes out
- 01Have a native speaker read the scriptBefore the voice is made, have someone who speaks the language read the translation. It's the cheapest moment to fix a mistake.
- 02Watch the close-upsWatch every shot where the face fills the frame, with the sound on, and look for words that land late.
- 03Check names and numbersPrices, dates, product names and phone numbers are the things a translation gets wrong most.
Only dub people who have agreed to it: yourself, your team, or someone who said yes in writing. Making a real person appear to say something they didn't say is not allowed, in any language. Tell viewers the voice was made with AI, too. In more and more places, the law asks for it.
Dub your first video
- 01Open CreateChoose Dub and add your video.
- 02Pick the languagesSay which languages, and whether the mouth has to match.
- 03Check and publishHave a native speaker check each one, then download them.
Start in Create with 300 free credits a month, no card needed. For the voices themselves, see our AI voice generator guide, and MiniMax Speech for narration in many languages.
Questions people ask
- What is AI dubbing?
- Putting a video into another language with AI: the words are transcribed, translated to fit the timing, read in a new voice, and the mouth is moved to match.
- Does AI dubbing keep the original voice?
- It can sound close to the original's tone and pace. Cloning someone's actual voice needs their clear permission.
- Do I need lip sync?
- Only when the speaker's face is large on screen. For wide shots or off-screen narration, a voiceover in the new language is enough.