A navigator with artificial intelligence (AI) has been developed at Novosibirsk State Technical University (NSTU) to help blind and visually impaired people navigate the terrain. The uniqueness of the system lies in its ability to work offline. This allows it to be used with a regular mobile phone without the need for an internet connection.
A person downloads the program we developed, turns on the camera, and attaches the gadget to their chest. Then a specially trained neural network takes over. From the video stream of frames, the AI recognizes the environment, the distance to potentially dangerous objects, and alerts the user with sound.
To recognize objects, the developers use a convolutional neural network model trained on manually labeled data. The AI is capable of warning the user about objects at a distance of about five meters. The system quickly responds to unexpectedly appearing obstacles, such as cars or closing gates, processing frames in 300 milliseconds.
The navigator is distinguished by the absence of advertising and paid subscriptions.
Earlier, www1.ru reported that Alice will tell blind and visually impaired people what is happening on the Kinopoisk screen.
Read materials on the topic:
Personal Year-End Results Launched on Yandex Music
Yandex Launches Innovative AI Service for Smartphones and PCs
Yandex Travel Presents New "My Places" Section for Trip Planning