Scientists from the St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS) have developed an artificial intelligence system MASAI that can recognize human emotions from video, audio, and text. The recognition accuracy reaches 80%, which exceeds the performance of existing analogues.
The system analyzes facial expressions, speech, and text data to determine seven basic emotions: joy, sadness, fear, disgust, surprise, anger, and calmness. In addition, the program conducts sentiment analysis, determining a person's positive, negative, or neutral attitude towards an event. MASAI can work with pre-recorded materials as well as in real time, including in noisy or poorly lit conditions.
The development is based on a group of several neural networks trained on multilingual databases with information about people of different ages, genders, and from different countries. Some of the data in Russian was provided by young actors from theater universities.
According to Alexey Karpov, Head of the Laboratory of Speech and Multimodal Interfaces at SPC RAS, the system can be integrated into digital assistants, for example, in call centers for emergency or psychological assistance services, to more accurately assess a person's condition.
The MASAI system can be integrated into various types of digital assistants that are now used in many areas of human life. For example, in telephone emergency services or psychological support, where emotional artificial intelligence will allow for a more effective response to human needs.
The development is supported by a grant from the Russian Science Foundation (RSF).
Read more materials on the topic:
Тестировщики приглашаются: в RuStore запустили возможность установки приложений до их публикации
Now on home
Hard and dense shot ensures the destruction of the target from the first hit, regardless of the drone's body material
Almost all body elements are zinc-treated
SOGAZ lost the case in court against UEC-UMPO
A rare SUV with a mileage of 38,533 km is offered for 2 million rubles
The government has included passenger and cargo airships among the key transport technologies of the future
Moscow sent 43 containers of weapons, including ATGMs and sniper rifles
There is a need to increase air traffic within Russia and abroad
Lada Niva Travel with a new 1.8-liter engine tested at temperatures of -25 and -30 °C
Производить первую энергию планировали ещё в апреле 2025 года
Retail is in second place, and education and medicine are in third place
The basic version of the system is capable of hitting targets at a range of up to 300 km
Security forces challenged the legality of yachting entertainment