Geek Dashboard

How-To's, Smartphones, News and Reviews

  • Home
  • News
  • Smartphones
    • Android
    • iOS
  • Computers
    • Windows
    • macOS
  • Internet
  • Reviews
You are at Home » News

YouTube’s new AI can describe sound effects in the captions automatically

Last Updated on March 27, 2017 by Rahul Krishnan Leave a Comment

YouTube has been captioning videos for eight years now. You can see captions on almost one billion videos. The feature was introduced back in 2009, to provide hearing impaired people with the best viewing experience.

The captioning was awful at the beginning. Nonetheless, Google didn’t ditch it but worked on the same to improve further. Their tries went fruitful as we see fewer errors on YouTube captions.

Google wants to take the captions to the next level. They want people who face hearing problems to capture every bit of the video via text. That’s why they have introduced sound effect recognition now.

YouTube’s Automatic Captions can Recognize Sound Effects

youtube caption
Source:- https://youtu.be/oOtqbAxRkyM

Google has collaborated with accessibility teams to build an AI algorithm that can understand the sound effects getting played with a video. You don’t have to manually do anything.

The company has used the techniques of machine learning to bring this feature to reality. Even though the feature is live now, you can’t get it to recognize every non-conversing sound, though.

Now, YouTube can only recognize and label three classes of sound; Laughter, Applause, and Music. When such sounds get played, you can see [laughter], [applause], or [music] as the caption.

Google chose those three sound categories because they are easy to capture and understand by the machine learning algorithm.

Also Read:- YouTube to Stop 30-second unskippable Ads from 2018

You may not use the captions. But according to the inside statistics of YouTube, videos with captions are played at least 15 million times a day. And, about 360 million people with hearing problems use the internet as well. Apparently, they will all receive the benefit of this new feature YouTube has rolled out.

According to Google engineers, developing the sound effect recognizing feature is the toughest as compared to speech recognition. And, the developments happened in machine learning field in the last couple of years have augmented the sound effect recognition.

During the developmental stages, Google engineers have trained the algorithm with thousands of hours of videos to fetch the best results. The company has also developed a deep neural network too. And, they faced challenges when it came to events happening at the same time (like laughter and applause).

As stated earlier, the feature is still in its infancy now. Once it gets mature, we can see captions for more sound effects. It may even recognize the device, from which the sound comes out (for example, alarm ringing, phone ringing, doorbell, etc.).

Do you want to check out the feature now? Play the video below and hit the CC button.

Posted inNews

Spread the Word!

Avatar for Rahul Krishnan

Rahul Krishnan Facebook Twitter

Rahul Krishnan, a wordsmith from Kerala, India is always in lookout for his next article idea. He is a fanatic reader. And, the rumour is that his mom has recently hidden his debit card so that he can't buy books anymore. She doesn't know he has a spare one.

Related articles

News

Vivo Y12G With Snapdragon 439 SoC Launched at Rs. 10,990 in India

Vivo Y12G
News

HP Omen 16 2021 Edition Gaming Laptop Launched with 11th Gen Intel Chipset in India

HP Omen 16
Internet

How to Change Spotify Playlist Picture on Android, iOS, and PC

Change Spotify Playlist Picture

Comment Policy:

The comments section is aimed to help our readers in case of any questions or you can even appreciate us for our hard work. Every comment is strictly moderated before approving it.

Your name and comment will be visible to the public. Never share your personal information in the comments section.

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Over 1,30,286+ Followers

Join to get latest updates from Geek Dashboard

Facebook Twitter Telegram Pinterest YouTube Instagram

Recently Published

  1. Nokia T21 Tablet with Unisoc T612 Chipset and 2K Display Launched in India

  2. Lenovo Yoga 9i 2-in-1 Laptop with 13th Gen Intel Core i7 Launched in India

  3. Lenovo Tab P11 5G Launched with 11-inch 2K Display and Snapdragon 750G SoC in India

  4. How To Select All Photos on iPhone and iPad Quickly

  5. iQOO 11 5G with Snapdragon 8 Gen 2 SoC and 120W Fast Charging Launched in India

Geek Dashboard Placeholder

Download the apps and never miss a story from us

We put a lot effort and resources in writing our articles and we believe it is our responsibility to satisfy your tech hunger. We will keep you filled forever!

  • Get Geek Dashboard App from Google Play
  • Get Geek Dashboard App from Chrome Web Store
Geek Dashboard Logo

At Geek Dashboard, we are dedicated to bringing you the latest and greatest in technology news, reviews, and how-to guides. From smartphones to laptops, and everything in between, we've got you covered.

Got a Tip? Write In tip@geekdashboard.com

© 2012 - 2023 · Geek Dashboard, product of ikva eSolutions

Blog Advertise About Jobs Contact Privacy Policy Write For Us T&C Office Setup

No dogs were injured while working on this website because we love them