Home Technology YouTube’s AI-driven dubbing: A comprehensive guide on its functionality and operation

YouTube’s AI-driven dubbing: A comprehensive guide on its functionality and operation

YouTube has introduced a revolutionary AI-powered feature aimed at bridging the language barrier for users worldwide. With the help of AI technology, Google’s popular video-sharing platform is making it easier for users to dub videos in different languages. The Aloud team, from Google’s Area 120 incubator, will be leading this project as announced at the VidCon event held in the US.
YouTube AI Dubbing: Availability
In an interview with The Verge, YouTube’s Amjad Hanif revealed that the platform is currently testing the tool with hundreds of creators. Hanif also mentioned that Aloud currently supports a few languages, but they are planning to add more in the near future. Currently, the Aloud dubbing tool supports English, Spanish, and Portuguese.
YouTube AI Dubbing: How It Works
Aloud’s website explains that before dubbing a video in another language, the tool first transcribes the video. It then displays the transcriptions to the user for reviewing and editing purposes. After that, it translates and produces the dubbing for the video. Google’s Aloud team has also shared a video demonstrating the functionality of the tool.

Aloud: Let’s overcome the language barrier in videos together

How It Benefits Creators
Despite supporting a limited number of languages, Aloud can be a valuable tool for creators. It enables them to add multi-language dubs to their videos, expanding their reach and audience engagement. According to Hanif, YouTube plans to enhance the tool’s capabilities in the future, making translated audio tracks sound like the creator’s voice with improved expression and lip sync. These features are expected to be available by 2024.
Last month, YouTube also utilized Google DeepMind’s AI to generate descriptions for YouTube Shorts. By analyzing the initial frames of a video, the visual language model called Flamingo was used to create accurate descriptions.

 

Reference

Denial of responsibility! TechCodex is an automatic aggregator of the all world’s media. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, and all materials to their authors. For any complaint, please reach us at – [email protected]. We will take necessary action within 24 hours.
Denial of responsibility! TechCodex is an automatic aggregator of Global media. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, and all materials to their authors. For any complaint, please reach us at – [email protected]. We will take necessary action within 24 hours.
DMCA compliant image

Leave a Comment