Meta will use AI to create lip-synced renditions of creators’ Reels
Meta recently announced an interesting tool that uses AI to automatically pronounce Reels in other languages, complete with lip sync. This feature was unveiled this year and was introduced by CEO Mark Zuckerberg.
Zuckerberg demonstrated this feature during the keynote, and everything seems to work flawlessly. The technology not only translates content, according to Meta, but will also “simulate a speaker’s voice in another language and lip sync to match.” It’s important to note, however, that this was never seen in a live demo. It’s still very sweet.
As for the rollout, the company says the feature will come first to “videos from select creators” in English and Spanish in the US and Latin America. Meta did not provide a timetable here. It recently said that the US and Latin America will be getting it first, indicating that it will be joined by English and Spanish at launch. The company says more languages are coming soon.
That wasn’t the only AI tool that stood out during Meta Connect. The company’s AI platform will now allow voice chats, with a selection of celebrity voices to choose from. Meta AI also gets new photo capabilities, as it will be able to change and edit photos directly from text conversations within Instagram. Messenger and WhatsApp.
Source link