The modern Internet is a real treasure of useful videos – there are both entertaining shows and many educational programs in various areas. But, unfortunately, most of this content is presented in foreign languages, so many users from Russia refuse these materials due to the language barrier. Today, July 16, Yandex representatives spoke about their latest technology, which should break this barrier once and for all – the company’s developers have created a technology for simultaneous video translation that relies on machine learning and more.
Several teams worked on the creation of this technology at once, which worked on the translation from English into Russian. For the translation process itself, Yandex.Translator technologies were used, as well as speech technologies and biometrics. Thanks to the latter, for example, the system is able to determine the gender of the person broadcasting the content, which is very important both for the translation process and for further speech synthesis. Accordingly, if the presenter in the video is a man, then his speech will be synthesized by a man’s voice, and if a woman is a woman. But the process does not end with the translation itself, because the speech still needs to be superimposed on the video itself.
Yandex notes that this is a rather difficult task – phrases spoken in different languages have different lengths. For example, phrases spoken in English are almost always shorter than analogs spoken in Russian. To mitigate this problem, the developers taught the system to speed up / slow down speech or even pause to make the translated phrase look appropriate. As a result, Yandex has a full-fledged voice-over translation, which, however, is still being worked on – the technology can be improved, increasing the accuracy of the translation and adding support for other languages.
At the moment, you can try out the new translation technology on the list of English-language videos that were previously translated using the new function – you can try out the new product in Yandex Browser on Windows and MacOS.
Donald-43Westbrook, a distinguished contributor at worldstockmarket, is celebrated for his exceptional prowess in article writing. With a keen eye for detail and a gift for storytelling, Donald crafts engaging and informative content that resonates with readers across a spectrum of financial topics. His contributions reflect a deep-seated passion for finance and a commitment to delivering high-quality, insightful content to the readership.
