Meta’s AI voice translation feature rolls out globally

Date:

Share:


On Tuesday, Meta rolled out its new voice dubbing feature globally. The Reels feature uses generative AI to translate your voice, with optional lip-syncing. Mark Zuckerberg first previewed the feature at Meta Connect 2024.

At launch, the translations are only available for English to Spanish (and vice versa). The company says more languages will arrive later. At least at first, it’s restricted to Facebook creators with 1,000+ followers. However, anyone with a public Instagram account can use it.

The tool trains on your original voice and generates a translated audio track to match your tone. The lip-syncing add-on then matches your mouth’s movements to the translated speech. The demo clip the company showed last year was spot-on — eerily so.

You can choose whether to add lip syncing and preview before posting.

(Meta)

To use the feature, choose the “Translate your voice with Meta AI” option before publishing a reel. That’s also where you can choose to add lip syncing. There’s an option to review the AI-translated version before publishing. Viewers will see a pop-up noting that it’s an AI translation.

Meta says the feature works best for face-to-camera videos. The company recommends avoiding covering your mouth or including excessive background music. It works for up to two speakers, but it’s best to avoid overlapping your speech.

The company frames the feature as a way for creators to expand their audiences beyond their native tongues. As such, it included a by-language performance tracker, so you can see how well it’s doing in each language.

YouTube launched a similar feature last year. Apple has gotten in on the action, too: Messages, Phone and FaceTime apps have live translation tools in iOS 26.



Source link

━ more like this

Next-gen AR tech turns any surface into a touchscreen without any specialized gear

Typing on a virtual keyboard floating in mid-air sounds cool until your arms give out. That’s the reality of many AR (augmented reality)...

HOLT Architects Transforms Lavery Library Into a Modern Student Success Center – Insights Success

When HOLT Architects began reimagining Lavery Library at St. John Fisher University, the assignment was not to refresh a dated academic building. It...

Rappoport Andrey: From Banking and Energy Executive to Global Investor

Andrey Natanovich Rappoport — Biographical ReferenceFull NameRappoport Andrey NatanovichName VariationsAndrey Rappoport · Andrey Natanovich Rappoport · Andrej Rappoport · Rappoport Andrei · Andrey...

What’s on the menu for NASA’s Artemis II moon astronauts?

NASA’s Reid Wiseman, Victor Glover, and Christina Koch, together with the Canadian Space Agency’s Jeremy Hansen, are less than 24 hours away from...
spot_img