Characters Sound Like They Know Russian: "Yandex Browser" Video Translation Reaches New Level

The neural browser analyzes English speech, highlighting timbre, rhythm, and intonations

"Yandex Browser" has introduced a new level of video translation. Modern neural networks now reproduce the original voices and intonations of characters, making voice-over translation more natural.

In the "Browser", you can now hear the characters of dubbed videos speaking in Russian. This has become possible thanks to a new technology based on artificial intelligence. The "Browser" uses a neural network that analyzes English speech, recognizes timbre, rhythm, and intonations, and reproduces them in Russian translation. To achieve this, the model was additionally trained on hundreds of thousands of audio recordings.

Watching videos has become more immersive and engaging. This is especially true for video materials where the speech component plays a key role: recordings of live performances, sketches, speeches by famous personalities.

The browser now more accurately conveys the meaning of what is said in the video. It takes into account the stylistic features of speech, which makes the formulations more natural.

The YandexGPT-based model used for video translation has become the leader in the quality of translation from English to Russian according to the results of the DiBiMT international independent testing.

Earlier, the "Yandex Market" application now has an AI-powered chat. It will help customers resolve any issues without searching for information in other sources. Artificial intelligence will select products upon request, describe their advantages, and compare them with similar options.

Read more on the topic:

Life made easier for cottagers: over 2000 seasonal routes added to "Yandex Maps"

"Yandex" Announces New Modular Speaker "Station Mini 3 Pro".

Who Created You Like This?: Joint Works of Neural Network and Human to be Presented by "Yandex" and the Tretyakov Gallery

Now on home