Yandex's Neural Network Learns to Follow the Thread of Conversation

Yandex told "Code Durov" about the innovations of the YandexGPT neural network: it has learned to follow the thread of conversation, can remember the course of the conversation, answer clarifying questions, and store correspondence history.

"At the user's request, Alice can give advice, act as a business partner or co-author. For example, you can discuss a business plan with her, compare all the pros and cons of buying a car, or prepare for an interview. She will come up with slogans, ideas for startups and dozens of post options for different audiences with you," Yandex said.

The company noted that maintaining context is a technically very difficult task, since the neural network must understand when to take into account previous remarks and when not to.

"For this, it was retrained on reference examples of anonymized dialogues. In less than three weeks, users asked Alice tens of thousands of questions requiring contextual answers, and AI trainers taught the model to give the most relevant answer to such requests. The Yandex team also used dialogues from the open source Open Assistant dataset," Yandex reported.

As a reminder, the YandexGPT neural network with Alice is available in the Yandex application, in the Browser, Stations, in TVs with Alice, and on the main page of the search engine (ya.ru).