Meta has launched a new AI-powered voice translation tool for Instagram and Facebook Reels. It will help creators break language barriers and reach broader audiences. The feature was first showcased at Meta Connect 2024 by CEO Mark Zuckerberg. Now, after lots of testing, the feature is finally rolling out to users. So, in this story, I have compiled 5 things that you should know about Meta’s latest offering.
1. Automatic Voice Translation With Lip-Sync
Creators can now dub their Reels with AI-generated translations that not only sound authentic but also match their lip movements. The tool uses Meta’s AI models to preserve the creator’s voice tone and timbre, making it seem like they’re genuinely speaking another language.
2. English-Spanish Support at Launch
Currently, the feature is only available for two-way translations between English and Spanish. However, according to the company, there are more languages on the way. Internal testing showed translated Reels drew about 20% more viewers, which highlights the demand for multilingual content.
3. Not Available Everywhere
While Meta is having a global rollout, there are some regions where it’s not available. For example, creators in the EU, UK, South Korea, Brazil, Australia, and some U.S. states like Texas and Illinois won’t have access due to local regulations around AI and biometric data.
4. Easy to Use With Added Analytics
In order to use the feature, you just have to select “Translate your voice with Meta AI” before posting a Reel. Once done, you can preview translations, turn on lip-sync, and even track performance with new analytics that show engagement by language. It is said to give you a clearer picture of how a particular content resonates across different audiences.
5. Best Practices for Creators
However, it’s not like this feature is going to work on all sorts of videos. Meta recommends creators face forward, speak clearly, and keep background noise to a minimum for the best results. The system supports up to two speakers, but you should avoid talking over each other to maintain translation accuracy.
That’s all about Meta or Instagram for now. But if you want to receive the latest updates delivered directly to your phone, then join us on WhatsApp to get all the latest happenings from the Tech and AI world.
