YouTube first went public with the idea of an AI-based auto-dubbing tool at Vidcon in 2023. Now, we can confirm that the feature is up for grabs to the masses as the company just began rollout today.
The useful offering is designed to launch translated audio tracks for all videos so creators can benefit from their channels. Now the feature will be available to hundreds of thousands of more channels on the app, the company shared.
The platform also sheds light on how the feature is designed to make content quicker to comprehend and easier to access for all individuals around the globe. The new feature is now present on all channels focused on providing informative content. This includes those videos that come under the explainer or teaching category. It also hopes to launch to other genres really soon to provide the greatest assistance to viewers.
In case you’re wondering how to use the feature, well, it’s quite simple. Just upload the content you want to share on your channel as usual and then leave the app to do the rest. The feature will detect the right language automatically and roll out dubbed variants in other languages such as English, German, Hindi, Spanish, Japanese, and more.
As expected, the latest feature makes use of Google’s Gemini talent which does a good job of replicating human speech. However, the company also shared how this feature might not perform too great as the tech is still in the early developmental stage.
The company says they’re hard at work to make it free from errors but inaccuracies can happen when translations don’t work out right or the dubbed voice is not correctly represented as the real speaker. They do hope to get feedback to help make things better as they wish to improve as time goes on.
The company also shared how creators can look forward to more updates on this front including Excessive Speech which helps in replicating the actual tone of the creator, their feelings, and any surrounding ambiance.
Read next: Instagram Gives Creators An Innovative Way To Test New Content With ‘Trial Reels’
The useful offering is designed to launch translated audio tracks for all videos so creators can benefit from their channels. Now the feature will be available to hundreds of thousands of more channels on the app, the company shared.
The platform also sheds light on how the feature is designed to make content quicker to comprehend and easier to access for all individuals around the globe. The new feature is now present on all channels focused on providing informative content. This includes those videos that come under the explainer or teaching category. It also hopes to launch to other genres really soon to provide the greatest assistance to viewers.
In case you’re wondering how to use the feature, well, it’s quite simple. Just upload the content you want to share on your channel as usual and then leave the app to do the rest. The feature will detect the right language automatically and roll out dubbed variants in other languages such as English, German, Hindi, Spanish, Japanese, and more.
As expected, the latest feature makes use of Google’s Gemini talent which does a good job of replicating human speech. However, the company also shared how this feature might not perform too great as the tech is still in the early developmental stage.
The company says they’re hard at work to make it free from errors but inaccuracies can happen when translations don’t work out right or the dubbed voice is not correctly represented as the real speaker. They do hope to get feedback to help make things better as they wish to improve as time goes on.
The company also shared how creators can look forward to more updates on this front including Excessive Speech which helps in replicating the actual tone of the creator, their feelings, and any surrounding ambiance.
Read next: Instagram Gives Creators An Innovative Way To Test New Content With ‘Trial Reels’
