The video translation technology in "Yandex Browser" has received a significant update: it now supports seven new languages. Users can watch videos in Italian, Spanish, French, Chinese, Japanese, Korean, and German.
Moreover, the translation is not just text or a neutral voice-over – the system strives to preserve the original voices and intonations of the characters. Previously, this feature was only available for English-language content.
For translation, the neural network analyzes the original audio track: it determines the timbre, rhythm, and speech characteristics of each speaker. After that, it reproduces these parameters in the Russian-language voice-over.
According to the company, about 1.7 million people use the translation function monthly. About a million of them choose voice-over with live voices.
The new feature works when watching videos on YouTube, in Yandex search, as well as on VK Video, "Dzen", and Rutube platforms. To enable it, you need to select the appropriate mode in the browser's media panel.