Meta’s AI voice translation feature rolls out globally

Date:

Share:


On Tuesday, Meta rolled out its new voice dubbing feature globally. The Reels feature uses generative AI to translate your voice, with optional lip-syncing. Mark Zuckerberg first previewed the feature at Meta Connect 2024.

At launch, the translations are only available for English to Spanish (and vice versa). The company says more languages will arrive later. At least at first, it’s restricted to Facebook creators with 1,000+ followers. However, anyone with a public Instagram account can use it.

The tool trains on your original voice and generates a translated audio track to match your tone. The lip-syncing add-on then matches your mouth’s movements to the translated speech. The demo clip the company showed last year was spot-on — eerily so.

You can choose whether to add lip syncing and preview before posting.

(Meta)

To use the feature, choose the “Translate your voice with Meta AI” option before publishing a reel. That’s also where you can choose to add lip syncing. There’s an option to review the AI-translated version before publishing. Viewers will see a pop-up noting that it’s an AI translation.

Meta says the feature works best for face-to-camera videos. The company recommends avoiding covering your mouth or including excessive background music. It works for up to two speakers, but it’s best to avoid overlapping your speech.

The company frames the feature as a way for creators to expand their audiences beyond their native tongues. As such, it included a by-language performance tracker, so you can see how well it’s doing in each language.

YouTube launched a similar feature last year. Apple has gotten in on the action, too: Messages, Phone and FaceTime apps have live translation tools in iOS 26.



Source link

━ more like this

Rappoport Andrey: From Banking and Energy Executive to Global Investor

Andrey Natanovich Rappoport — Biographical ReferenceFull NameRappoport Andrey NatanovichName VariationsAndrey Rappoport · Andrey Natanovich Rappoport · Andrej Rappoport · Rappoport Andrei · Andrey...

What’s on the menu for NASA’s Artemis II moon astronauts?

NASA’s Reid Wiseman, Victor Glover, and Christina Koch, together with the Canadian Space Agency’s Jeremy Hansen, are less than 24 hours away from...

Does Intuit Enterprise Suite (IES) integrate with 3rd party apps?

Intuit Enterprise Suite (IES) integrates with 3rd party applications through APIs and the broader QuickBooks ecosystem. These integrations allow businesses to connect accounting...

Google’s Find Hub website can now locate more devices, even without your phone

Google has been steadily building out Find Hub, and the latest update is a meaningful one. Previously, you could only track phones, tablets,...

Apple finally teaches Siri to handle more than one thing

Apple is reportedly giving Siri something users have been asking for since… well, forever: the ability to handle multiple commands in one go....
spot_img